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EXECUTIVE SUMMARY 


“Just got off [an] hour long call with [Senior Advisor to President Biden] Andy 
Slavitt. ... [H]e was outraged — not too strong of a word to describe his reaction — 
that we did not remove this post. ... I countered that removing content like that 
would represent a significant incursion into traditional boundaries of free 
expression in the US but he replied that the post was directly comparing Covid 
vaccines to asbestos poisoning in a way which demonstrably inhibits confidence in 
Covid vaccines amongst those the Biden Administration is trying to reach.” 


— Sir Nick Clegg, Meta’s President of Global Affairs, former Deputy 
Prime Minister of the United Kingdom, describing his efforts to explain 
the boundaries of the First Amendment to the Biden White House in April 
2021.' 


This interim report details the monthslong campaign by the Biden White House to coerce 
large companies, namely Meta (parent company of Facebook), Alphabet (parent company of 
YouTube), and Amazon, to censor books, videos, posts, and other content online. By the end of 
2021, Facebook, YouTube, and Amazon changed their content moderation policies in ways that 
were directly responsive to criticism from the Biden Administration. 


While the Biden White House’s pressure campaign largely succeeded, its effects were 
devastating. By suppressing free speech and intentionally distorting public debate in the modern 
town square, ideas and policies were no longer fairly tested and debated on their merits. Instead, 
policymakers implemented a series of public health measures that proved to be disastrous for the 
country. From unnecessary extended school closures to unconstitutional vaccine mandates that 
forced workers to take a newly developed vaccine or risk losing their jobs, the Biden 
Administration and other officials needlessly imposed harm and suffering on Americans across 
the country. 


Ongoing litigation and the publication of the Twitter Files following Elon Musk’s 
acquisition of the company began to provide some insight into the behind-the-scenes efforts of 
the Biden White House to censor political opponents and disfavored views. For example, on just 
the third day of the Biden Administration, the White House emailed Twitter (now X) personnel 
to demand that a tweet by Robert F. Kennedy, Jr. be “removed ASAP.”” The directive was not 
limited to just Kennedy; in the same email, the Biden White House asked Twitter to also “keep 
an eye out for tweets that fall in this same genre.”? 


But the most important documents to understanding the Biden White House’s censorship 
efforts have proven to be internal emails from the companies on the receiving end of White 
House threats and coercion. After issuing dozens of subpoenas to Big Tech, government 
agencies, and relevant third parties, the Committee on the Judiciary and Select Subcommittee on 
the Weaponization of the Federal Government began to obtain tens of thousands of documents 


' See Internal email from Nick Clegg to Facebook personnel (Apr. 18, 2021, 9:07 PM) ; see Ex. 29. 
> Missouri v. Biden, 3:22-cv-01213, (W.D. La. Jan. 11, 2023) ECF No. 174-1 (Ex. A). 
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illustrating the details of the Biden White House’s pressure campaign. Obtaining key internal 
company communications—often including the highest levels of company leadership—took 
additional escalatory measures from the Committee and Select Subcommittee, including threats 
to hold Meta CEO Mark Zuckerberg in contempt of Congress.* 


Now, having obtained and reviewed tens of thousands of emails and other relevant 
nonpublic documents, the Committee and Select Subcommittee can provide a more complete 
picture of how and the extent to which the Biden White House coerced companies to suppress 
free speech. 


e Big Tech Changed Their Content Moderation Policies Because of Biden White 
House Pressure. The Biden White House pressure campaign largely succeeded in 2021. 
In the weeks and months following the start of the White House pressure campaign, 
Facebook, YouTube, and Amazon all changed their content moderation policies. The 
White House pressured companies to censor information that did not violate their content 
moderation policies at the time. The best evidence to assess why content moderation 
policies were changed is to review relevant email correspondence and other documents at 
the time of the policy change. Indeed, both Facebook and Amazon referred to the Biden 
White House’s efforts as “pressure.”° Here is a subset of key documents first obtained by 
the Committee and Select Subcommittee pursuant to subpoena: 


o In March 2021, an Amazon employee emailed others within the company about the 
reason for the Amazon bookstore’s new content moderation policy change: “[T]he 
impetus for this request is criticism from the Biden Administration about sensitive 
books we’re giving prominent placement to.”° 


o In March 2021, just one day prior to a scheduled call with the White House, an 
Amazon employee explained how changes to Amazon’s bookstore policies were 
being applied “due to criticism from the Biden people.”’ 


o In July 2021, when Facebook executive Nick Clegg asked a Facebook employee why 
the company censored the man-made theory of the SARS-CoV-2 virus, the employee 
responded: “Because we were under pressure from the [Biden] administration and 
others to do more. ... We shouldn’t have done it.” 


4 See, e.g., Ryan Tracy, Mark Zuckerberg Could Be Held in Contempt of Congress: What to Know, WALL ST. J. 
(Apr. 27, 2023); see also STAFF OF THE H. JUDICIARY COMM. & THE SELECT SUBCOMM. ON THE WEAPONIZATION OF 
THE FED. GOV’T, THE WEAPONIZATION OF 'DISINFORMATION' PSEUDO-EXPERTS AND BUREAUCRATS: HOW THE 
FEDERAL GOVERNMENT PARTNERED WITH UNIVERSITIES TO CENSOR AMERICANS' FREE SPEECH, at 2, 86-87 (Nov. 6, 
2023) (on file with the Comm.) (the Committee threatened contempt after Stanford initially refused to provide 
critical documents and information responsive to the Committee’s subpoena). 

5 See, e.g., Internal email from Facebook personnel to Mark Zuckerberg (June 6, 2021, 2:24 PM); see Ex. 37. 
Internal email between Amazon personnel (Mar. 12, 2021, 2:47 PM); see Ex. 135. 

® Internal email between Amazon employees (Mar. 4, 2021, 2:18 PM); see Ex. 131. 

7 Internal email between Amazon employees (Mar. 8, 2021, 8:28 AM); see Ex. 132. 

8 Internal email from Facebook personnel to Nick Clegg (July 14, 2021, 7:44 PM); see Ex. 52. 
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o In August 2021, an internal Facebook email explained why the company was 
developing, and ultimately implementing, new content moderation policies: 
“[Facebook’s] Leadership asked Misinfo Policy . . . to brainstorm some additional 
policy levers we can pull to be more aggressive against . . . misinformation. This is 
stemming from the continued criticism of our approach from the [Biden] 
administration.” 


o In September 2021, after receiving months of criticism for not censoring non- 
violative content, YouTube shared with the Biden White House a new “policy 
proposal” to censor more content criticizing the safety and efficacy of vaccines, 
asking for “any feedback” the White House could provide before the policy had been 
finalized.'!° The White House gushed: “at first blush, seems like a great step.”!! 


e The Biden White House’s Censorship Campaign Targeted True Information, Satire, 
and Other Content that Did Not Violate the Platforms’ Policies. Contrary to their 
claims of wanting to combat alleged so-called “misinformation” and foreign 
disinformation, the Biden Administration pressured the companies to censor true 
information, satire, memes, opinions, and Americans’ personal experiences. 


o For example, internal July 2021 Facebook emails obtained by the Committee and 
Select Subcommittee show that Facebook understood that the Biden White House’s 
position as wanting “negative information on or opinions about the vaccine” removed 
as well as “humorous or satirical content that suggests the vaccine isn’t safe.” 


o The same set of emails also noted that “The Surgeon General wants us to remove true 
information about side effects.” 


e The Biden White House’s Censorship Campaign had a Chilling Effect on Other 
Speech. In February 2021, Facebook increased its censorship of several topics— 
including those related to the origin of the SARS-CoV-2 virus—as part of a general 
response to the Biden White House’s pressure to “do more.”’!* After a few months it 
became clear that the Biden White House’s focus was on alleged vaccine misinformation. 
In May 2021, Facebook stopped removing content about the lab leak theory, which even 
parts of the Biden Administration consider true today.'° Zuckerberg privately told top 
Facebook officials that “[t]his seems like a good reminder that when we compromise our 


° Internal email between Facebook personnel (Aug. 2, 2021, 5:39 PM); see Ex. 70. 

° Email from Google & YouTube personnel to Rob Flaherty (Sep. 21, 2021, 1:52 PM); see Ex. 114. 

' Email from Rob Flaherty to YouTube & Google personnel (Sep. 29, 2021, 9:23 AM); see Ex. 114. 

? Internal email from Facebook personnel to Nick Clegg (July 21, 2021, 8:35 PM); see Ex. 63. 

3 Td. 

4 Internal email between Facebook personnel and Mark Zuckerberg (June 4, 2021, 2:24 PM); see Ex. 37; (“In 
February 2021, in response to public pressure and tense conversations with the new [Biden] Administration, we 
started removing” the “Wuhan lab leak theory.”’). 

> See, e.g., Hannah Rabinowitz, FBI Director Wray acknowledges bureau assessment that Covid-19 likely resulted 
from lab incident, CNN (Mar. 1, 2023); see also Jeremy Herb & Natasha Bertrand, US Energy Department assesses 
Covid-19 likely resulted from lab leak, furthering US intel divide over virus origin, CNN (Feb. 27, 2023). 
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standards due to pressure from an administration in either direction, we’ll often regret it 
later.”!° 


e The White House had Leverage Because the Companies had Other Policy Concerns 
Involving the Biden Administration. 


o In July 2021, Clegg emailed others in the company that “[g]iven the bigger fish we 
have to fry with the [Biden] Administration,” Facebook should try to think creatively 
about “show we can be responsive to [the Administration’s] concerns.”!” 


o In April 2021, YouTube’s Public Policy team emailed YouTube’s Product team that 
having the Product team brief the Biden White House would be “hugely beneficial” 
because the company was “seek[ing] to work closely with [the Biden] administration 
on multiple policy fronts.”!® 


e The Biden White House Pushed Censorship of Books, Not Just Social Media. The 
Biden White House pressure campaign was not limited to just social media companies, 
but also the world’s biggest online bookstore, Amazon.!” 


The parallels for the three companies are striking. In each case, the companies identified 
the Biden White House’s censorship requests as “pressure” or noted a fear that things could 
“spiral[] out of control.”?° And while there is a difference in how long and in what ways each 
company succumbed to the White House’s pressure, by September 2021, Facebook, YouTube, 
and Amazon had each adopted new content moderation policies that removed or reduced 
viewpoints and content disfavored by the Biden White House.7! 


The Facebook Files. In February 2021, Facebook increased its censorship of anti- 
vaccine content as well as the lab leak theory of the origin of the virus because of “tense 
conversations with the new [Biden] Administration” and as part of an effort to be responsive to 
the Biden White House’s exhortations to “do more” to combat alleged misinformation.” After a 
few months, Facebook realized the White House cared more about censoring anti-vaccine 
content and so the company lifted its censorship of the lab-leak theory. In response, Zuckerberg 
said the mistake served as a reminder to not “compromise our standards due to pressure from an 
administration.”?? 


'6 Internal email from Mark Zuckerberg to Facebook personnel (June 6, 2021, 10:31 AM); see Ex. 37. 

7 Internal email from Nick Clegg to Facebook personnel (July 22, 2021, 12:20 AM); see Ex. 64. 

'8 Internal email between YouTube personnel (Apr. 29, 2021, 4:38 PM); see Ex. 109. 

'9 Internal email between Amazon personnel (March 9, 2021, 11:59 AM); see Ex. 134. 

20 See, e.g., Internal email from Facebook personnel to Nick Clegg (July 14, 2021, 7:44 PM) (on file with the 
Comm.); Internal email between Amazon personnel (March 12, 2021, 2:47 PM); see Ex. 135; Internal email 
between YouTube & Google personnel (Apr. 22, 2021, 7:06 PM); see Ex. 107. 

*1 Internal email between Amazon personnel (March 8, 2021, 8:28 AM); see Ex. 131; Internal email between 
Facebook personnel and Mark Zuckerberg (June 4, 2021, 2:24 PM); see Ex. 37; Email from Google & YouTube 
personnel to Rob Flaherty (Sep. 21, 2021, 1:52 PM) ; see Ex. 131. 

>? Internal email from Facebook personnel to Mark Zuckerberg (June 6, 2021, 2:24 PM); see Ex. 37.; internal email 
from Facebook personnel to Nick Clegg (July 14, 2021, 7:44 PM); see Ex. 52. 

3 Internal email from Facebook personnel to Mark Zuckerberg (June 6, 2021, 2:24 PM); see Ex. 37. 
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But Facebook continued to face continued pressure from the Biden Administration to 
censor content questioning vaccines, including true information, satire, memes, and other lawful 
content that is constitutionally protected and not violative of Facebook’s content moderation 
policies. In July 2021, tensions hit a fever pitch, with President Biden publicly accusing 
Facebook of “killing people.””4 Noting that they had “bigger fish to fry” with the Biden 
Administration, such as issues related to “data flows,” senior Facebook officials decided in 
August 2021 to enact new content moderation policies that would censor more anti-vaccine 


content.?> An 
internal August 
2021 email states 
plainly that the 
decision 
“stemm[ed] from 
the continued 
criticism of our 
approach from 
the [Biden] 


administration.””° 


4 Nandita Bose & Elizabeth Culliford, Biden says Facebook, others ‘killing people’ by carrying COVID 


FACEBOOK FILES 


February 8, 2021 
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April 16, 2021 
SeeCeeeeeeeeeeeeeeeeeee 
Slavitt tells ¢ 
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says that woulk 
violate the First 
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July 15, 2021 
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misinformation, REUTERS, (July 16, 2021). 
5 Internal email from Nick Clegg to Facebook personnel (July 22, 2021, 12:20 AM); see Ex. 64. 
26 Internal email between Facebook personnel (Aug. 2, 2021, 5:39 AM); see Ex. 70. 
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The YouTube Files. In the spring of 2021, the Biden White House increased pressure on 
YouTube to remove and reduce alleged misinformation, including “borderline content”—1.e., 
content that did not violate YouTube’s policies.”’ Internally, YouTube asked its Product team to 
brief the White House directly because the company feared the situation could “potentially 
spiral[] out of control.””® Throughout the summer, the White House continued to press YouTube 
about its policies and 
enforcement, 
sometimes asking YOUTUBE FILES 
why particular videos 
were not removed or 
otherwise demoted.” 
In September 2021, as 
YouTube prepared to 
finalize a new policy 
“proposal” to censor 
content that Houndansen, White Hote 
questioned the safety ~ qwhax te net hetbTa 
or efficacy of Baga 
vaccines, YouTube per patie Dab) 
emailed the White ream, asking if 
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27 See, e.g., Email from Rob Flaherty to YouTube & Google personnel (Apr. 12, 2021, 3:01 PM); see Ex. 100; 
Internal email between YouTube & Google personnel (Apr. 13, 2021, 6:08 AM); see Ex. 101; see also Reduce: How 
does YouTube reduce the spread of harmful misinformation, YouTube Content Policies & Community Guidelines, 
https://www.youtube.com/howyoutubeworks/our-commitments/managing-harmful-content/#reduce. 

8 Internal email between YouTube & Google personnel (Apr. 22, 2021, 10:38 PM); see Ex. 107. 

2° Email from Rob Flaherty to YouTube & Google personnel (July 20, 2021, 10:57 AM); see Ex. 112; see also 
Daniel Dale (@ddale8), X (July 19, 2021, 10:32 PM), https://twitter.com/ddale8/status/1417130268859772929 

3° Email from Google & YouTube personnel to Rob Flaherty (Sep. 21, 2021, 1:52 PM); see Ex. 114. 

3! Email from Rob Flaherty to YouTube & Google personnel (Sep. 29, 2021, 9:23 AM); see Ex. 114. 
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The Amazon Files. On March 2, 2021, the Biden White House emailed the Vice 
President of Public Policy at Amazon, asking to have a discussion regarding the “high levels of 
propaganda and misinformation and disinformation at Amazon.”*” To support their allegations, 


multiple members of the Biden White House ran keyword searches on Amazon for “vaccines” 
and emailed screenshots of the search results page to Amazon, noting that just adding a CDC 
warning would be insufficient to adequately censor the books.** Immediately after the initial 
email outreach from the White House, Amazon internally accelerated its consideration of 
implementing a new policy that would disfavor anti-vaccine books.** Internal talking points 


prepared by Amazon 
included the question: 
“Ts the [Biden] Admin 
asking us to remove 
books, or are they 
more concerned about 
search results/order (or 
both)?”?> On March 9, 
just one week after the 
initial outreach from 
White House official 
Andy Slavitt and the 
same day as the 
company’s scheduled 
meeting with the White 
House, Amazon 
implemented a new 
policy that added the 
“Do Not Promote” 


label for anti-vaccine 
books.*° 


AMAZON FILES 
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32 Jim Jordan (@Jim_Jordan), X (Feb. 5, 2024, 5:44 PM), https://x.com/Jim_Jordan/status/1754637209586606319. 
33 Email from Zach Butterworth to Amazon personnel (Mar. 2, 2021, 2:53 PM); see Ex. 125. 

34 Internal email between Amazon personnel (Mar. 4, 2021, 11:48 AM); see Ex. 131. 

35 Internal email between Amazon personnel (Mar. 9, 2021, 11:59 AM); see Ex. 134. 

36 Td.; Transcribed Interview of Amazon’s Vice President of Public Policy, H. Judiciary Comm.(Apr. 16, 2024), (on 


file with the Comm.). 


The First Amendment prohibits the government from “abridging the freedom of 
speech.” Thus, “any law or government policy that reduces that freedom on the [social media] 
platforms . . . violates the First Amendment.”** To inform potential legislation, the Committee 
and Select Subcommittee have been investigating the Executive Branch’s collusion with third- 
party intermediaries to censor speech. The Committee and Select Subcommittee have uncovered 
other serious violations of the First Amendment throughout the Executive Branch during the 
Biden Administration.*? 


The Committee and the Select Subcommittee are responsible for investigating 
“violation[s] of the civil liberties of citizens of the United States.’*° In accordance with this 
mandate, this interim staff report on the Biden White House’s violations of the First Amendment 
and other unconstitutional activities continues to fulfill the obligation to identify and report on 
the weaponization of the federal government against American citizens. The Committee’s and 
Select Subcommittee’s investigation remains ongoing. The Biden White House still has not 
adequately complied with a request for relevant documents, and more fact-finding is necessary. 
In order to better inform the Committee’s legislative efforts, the Committee and Select 
Subcommittee will continue to investigate how the Executive Branch worked with social media 
platforms and other intermediaries to censor disfavored viewpoints in violation of the U.S. 
Constitution. 


37 U.S. Const. amend. I (emphasis added). 

38 Philip Hamburger, How the Government Justifies Its Social-Media Censorship, WALL ST. J. (June 9, 2023); see 
Smith v. California, 361 U.S. 147, 157 (1959) (Black, J., concurring) (“Certainly the First Amendment’s language 
leaves no room for inference that abridgments of speech and press can be made just because they are slight.’’). 

» See, e.g., Ryan Tracy, FTC Twitter Investigation Sought Elon Musk’s Internal Communications, Journalist 
Names, WALL ST. J. (Mar. 8, 2023); STAFF OF SELECT SUBCOMM. ON THE WEAPONIZATION OF THE FED. GOV’T OF 
THE H. COMM. ON THE JUDICIARY, 118TH CONG., FIGHTING THE WEAPONIZATION OF THE INTERNAL REVENUE 
SERVICE: THE END OF ABUSIVE UNANNOUNCED FIELD VISITS (Comm. Print, 2023). 

40H. Res. 12 § 1(b)(E). 
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I. THE FACEBOOK FILES 


“We are facing continued pressure from external stakeholders, including the 
[Biden] White House. . . to remove more COVID-19 vaccine discouraging content. 
For example, we recently shared with the White House a list of the top 100 vaccine- 
related posts on FB in the U.S. for the week of 4/5-4/11. While authoritative 
information dominated the list, the White House was concerned that the #3 post 
was a vaccine discouraging humorous meme, and they called on us to delete the 


meme.””! 


— Draft email for Facebook CEO Mark Zuckerberg and COO Sheryl Sandberg, “seeking 
guidance” on “whether to take more aggressive action against certain vaccine 
discouraging content” (April 27, 2021, 11:58 AM). 


The Facebook Files illustrate the dangers of government coercion against free expression. 
In response to “tense conversations with the new [Biden] Administration” and pressure “to do 
more,” Facebook began censoring in February 2021 not just anti-vaccine content, but also claims 
that the SARS-CoV-2 virus was manmade.** By May 2021, Facebook understood that the Biden 
White House wanted anti-vaccine content censored and decided to lift its censorship of the lab- 
leak theory. In response, CEO Mark Zuckerberg said the mistake should serve as a reminder to 
not “compromise our standards due to pressure from an administration.”“? More importantly, the 
overly expansive censorship effort shows one of the ways government coercion has a chilling 
effect: Facebook did not know exactly what to censor to appease the Biden White House and, 
consequently, censored even more. 


The Facebook Files also show continued pressure from the Biden Administration 
eventually reached its breaking point with President Biden publicly accusing Facebook of 
“killing people.’“4 Although Facebook disagreed with the Administration’s push for Facebook to 
censor “true information,” “negative information on or opinions about the vaccine,” and 
“humorous or satirical content,” the company finally relented and expanded its content 
moderation policies in August 2021.*° Internal Facebook emails show that the decision 
“stemm[ed] from the continued criticism of our [Facebook’s] approach from the [Biden] 
administration.’*° After months of pressure, top Facebook executives, including Mark 
Zuckerberg, Sheryl Sandberg, and Nick Clegg decided that Facebook had “bigger fish to fry” 
with the Biden Administration, such as issues related to “data flows,” and defending free 
expression on the companies’ platforms was not worth drawing the ire of the powerful office in 
the world.*” 


4! Internal email from Facebook personnel to Mark Zuckerberg and Sheryl Sandberg (Apr. 27, 2021, 11:58 AM); see 
Ex. 31. 

* Internal email from Facebook personnel to Mark Zuckerberg (June 6, 2021, 2:24 PM); see Ex. 37. 

43 Internal email between Facebook personnel (August 2, 2021, 5:39 PM); see Ex. 29. 

44 See Nandita Bose & Elizabeth Culliford, Biden says Facebook, others ‘killing people’ by carrying COVID 
misinformation, REUTERS (July 16, 2021). 

4 Internal email from Facebook personnel to Nick Clegg (July 21, 2021, 8:35 PM); see Ex. 63. 

4 Internal email between Facebook personnel (August 2, 2021, 5:39 PM); see Ex. 29. 

47 Email from Nick Clegg to Facebook personnel (July 22, 2021, 12:20 AM); see Ex. 64; House Judiciary 
Committee’s Transcribed Interview of Nick Clegg (Mar. 1, 2024), at 81 (on file with the Comm.) 
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A. February 2021: Biden White House Begins Its Pressure Campaign; Facebook 
Preemptively Increases Censorship Around the Origin of the Virus 


The Biden White House’s censorship efforts started in the very first days of the new 
Administration.“ The Biden campaign had previewed for months that removing content 
disfavored by the left would be a top priority.” Social media platforms, including Facebook, 
took notice and began expanding their content moderation policies after the new Administration 
took office. 


In Facebook’s February 8, 2021, public statement announcing a change to its content 
moderation policies, the company noted that it would “remove” several new claims on its 
platforms, including claims that “COVID-19 is man-made.’””°° That same day, Facebook emailed 
the Biden White House to alert it that Facebook would be “expanding [its] efforts to remove 
false claims on Facebook and Instagram about COVID-19, COVID-19 vaccines, and vaccines in 
general.”>! 


Facebook ultimately expanded its censorship of the lab leak theory from February to May 
2021.7 Internal Facebook emails from late May and early June to top senior Facebook 
executives, including Facebook CEO Mark Zuckerberg, explain why Facebook changed its 
policies in the early days of the Biden Administration to remove claims supporting the lab leak 
theory. Most notably, a June 6, 2021 email to Zuckerberg explained that Facebook made these 
changes in response to “tense conversations with the new [Biden] Administration.” 


48 Internal email between Facebook personnel (August 2, 2021, 5:39 PM); see Ex. 29. 

” See, e.g., Transcript of Joe Biden’s Dec. 16, 2019 Interview with The New York Times editorial board, N.Y. 
TIMES, (Jan. 17, 2020), available at https://www.nytimes.com/interactive/2020/01/17/opinion/joe-biden-nytimes- 
interview.html; Our Open Letter to Facebook, BIDEN FOR PRESIDENT (June 11, 2020), available at 
https://joebiden.com/2020/06/1 1/our-open-letter-to-facebook/; see also Chandelis Duster, Kamala Harris says 
Trump’s Twitter account should be suspended, CNN (Sept. 30, 2019). 

5° An Update on Our Work to Keep People Informed and Limit Misinformation About COVID-19, META (Feb. 8, 
2021). 

5! Email from Facebook personnel to White House staff (Feb. 8, 2021, 10:37 AM); see Ex. 64. 

>? Internal email from Facebook personnel to Mark Zuckerberg (June 4, 2021, 2:24 PM); see Ex. 37. 

3 Id. 
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From: E> {> com> 


Sent: Friday, June 4, 2021 2:24:20 >M 


To: Matk Zuckerberg fo.com? 
- Ni fb.com>; Joel Kaplat WS > com>: 


fb.com>; bfb.com>; 
Subject: Covid misinformation. Wuhan lab leax theory 


Mark: 


On the question of our decision to remove claims related to the origin of COVID -- in May 2020, we decided to 
leverage existing work from 3PFCs (because they were overwhelmed by Covid misinfo) by FB claim-matching for 


claims that multiple 3PFCs had labeled as false instead of requiring the 3PFCs to find and manually add their 
fact-checks to any content making the claims. There were five claims that met the standard, including the claim 
that Covid is “man-made, manufactured, bioengineered, a bioweapon, or created by an individual government or 
country,” which includes claims that the virus was modified through gain of function research and leaked from a 
lab. Between May 2020 and February 2021, we reduced distribution for content making the five claims, applied a 
label, and linked to the debunking article. 


In February 2021, in response to continued public pressure and tense conversations with the new Administration, 
we started removing the five Covid claims that had been repeatedly debunked by 3PFCs and the eight claims that 
we had identified (in partnership with WHO, CDC, and other public health authorities) before Covid as widely 
debunked vaccine misinformation. You asked us at the time to review the decision later in the year to determine if 
we should revert to reduce & inform. 


The June 6 email notes that Zuckerberg had asked his team “to review the decision later 
in the year to determine if we should revert to reduce & inform.”** Ultimately, on May 26, 2021, 
Facebook announced that it would stop removing posts claiming that the virus was man-made 
“given the renewed debate on the topic” indicating that the “issue [was] no longer settled.”°> The 
June 6 email to Zuckerberg admitted that having to reverse course following months of censoring 
this claim was “ultimately a bad outcome” and that the company was working to “revert all 
repeatedly fact-checked claims from a ‘remove’ penalty to a ‘reduce & inform’ penalty.”~° 


Last month, two of the 3PFCs that rated the “man-made” claim as false changed their fact-checks. Poolitifact 
publicly rescinded its original fact-check. Factcheck.org updated its fact-check to acknowledge uncertainty. As this 
claim was no longer had multiple false fact-checks, we removed it from our list of claims that we were removing. 


While we believe we made appropriate decisions based on the information we had at the time, we also think this is 
ultimately a bad outcome, so we are working to revert all repeatedly fact-checked claims from a “remove” penalty 
to a “reduce & inform” penalty. 


In response, Mark Zuckerberg replied, “This seems like a good reminder that when we 
compromise our standards due to pressure from an administration in either direction, we’ ll often 
regret it later.”°’ 


4 Td. 
3 Id. 
56 Td. 
57 Internal email from Mark Zuckerberg to Facebook personnel (June 6, 2021, 10:31 AM); see Ex. 37. 
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From: Mark Zuckerberg tp com> 
Sent: Sunday, June 6, 2021 10:31 AM 
To: 


Ce: Nick Cegg; Joe! Kep\ar; 


Subject: Re: Covid misinformation: Wuhen lab leak theory 


Thanks for the context. This seems like a good reminder that when we compromise our standards due to pressure 
from an administration in either direction, we'll often regret it later. 


One member of Facebook’s Trust & Safety team—the team responsible for content 
moderation—forwarded Zuckerberg’s response, noting that being able to reference Zuckerberg’s 
message (and that he was the one to have said it) should help the team push back against other 
Facebook teams that may try to pressure Trust & Safety going forward.*® This hope was short 
lived, however,. Within two months of this email, Facebook would again succumb to outside 
pressure, changing its content moderation policies because of “continued criticism of 
[Facebook’s] approach from the [Biden] administration.’”*” 


On Jun 6, 2021, at 1.59 PM, | com> wrote: 


Please don’t share this email further but feel very comfortable referencing this message (and that Mark said it) if 
internal teams are pressuring us going forward. 


From: Mark Zuckerberglillptb.com> 

Sent: Sunday, June 6, 2021 10:31 AM 

‘er 

Ce: le; 


Subject: Re: Covid misinformation: Wuhen lab leak theory 


Thanks for the context. This seems like a good reminder that when we compromise our standards due to pressure 
from an administration in either direction, we'll often regret it later. 


In Internal emails in July 2021—when Facebook was facing immense White House 
pressure to change its content moderation policies again—Clegg asked his team for a reminder of 
why Facebook removed “claims that Covid is man made”?™ 


58 Internal email from Facebook personnel to Mark Zuckerberg (June 4, 2021, 2:24 PM); see Ex. 37. 
» Internal email between Facebook personnel (August 2, 2021, 5:39 PM); see Ex. 29. 
® Internal email from Nick Clegg to Facebook personnel (July 14, 2021, 11:41 AM); see Ex. 52. 
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From: Nick Cleag <i@fb.com=> 
, 14. 2021 11:41:56 AM 
@fb.com> @fb.com> @ 
@fb.com 2 @{b.com>. i 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Can someone quickly remind me why we were a om than demoting/labeling — claims that Covid is man 
made before May? oa NS 
; 4 


His team replied, “Because we were under pressure from the administration and others to 
do more and it was part of the ‘more’ package. [] We shouldn’t have done it.”°! 


From: 
Date: Wednesday, July 14. 2021 at 7°44 PM 
To: Nick Clegg < @fb.com> 
@fb.com> 
@fb.com> 


@fb.com> 
Subject: Re Brief 07.14 21 - Andy Slavitt Podcast 


Because we were under pressure from the administration and others to do more and it was part of the “more 
package. Ve removed four claims that multiple fact checkers had labeled false even though we didn’t have a harm 
assessmem, VVe shouldn't have done it. We stopped removing the man made claim inlay and now we're 
moving the other three claims (covid is new/patented) from remove to reduce and 


Despite having regrets for how they handled censorship of the lab-leak theory, Facebook 
again would relent to the Biden White House’s pressure campaign later that summer. 


B. February-March 2021: Biden White House Begins to Pressure Facebook to Censor 
More Anti-Vaccine Content 


Engagements between the White House and Facebook picked up in earnest by early 
February. After Facebook’s February 8, 2021, public announcement about censoring anti- 
vaccine content and the lab-leak theory, Rob Flaherty, who then served as the White House’s 
Digital Director, emailed Facebook, questioning whether the company would actually follow 
through on its censorship promises as articulated in the announcement.” 


6! Internal email from Facebook personnel to Nick Clegg (July 14, 2021, 7:44 PM); see Ex. 52. 
6 Emails from Rob Flaherty to Facebook personnel (Feb. 8 — 9, 2021); see Ex. 4. 
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From: Flaherty, Robert EOP/WHO 
Sent: Vonday, February 8, 2021 1:37 PM 
To: fb.com>; Rowe, Cou 
Humphrey, Clarke =OP/WHO < y 
Ce: fb.com>; 
fb.com> 
Subject: RE: COV!ID-19 Outreach to communties worldwice 


BE n2nks. 


This line, of course, stands out: 
that repeatedly share these debunked claims may be removed altogether. 


Can you share more about your framework here? May, of course, is very different than “will.” Is there a strike 
policy, ala Youtube? Does the severity of the claims matter? 


And as far as your removal of claims, do you have data on the actual number of claims-related posts you've 
removed? Do you have a sense of how many are being flagged versus how many are being removed? Are there 
actions (downranking, etc) that sit before removal? How are you handling things that are dubious, but not provably 
false? 


Thanks 


Facebook provided the White House with some initial materials and set a meeting for 
February 23, 2021.° During the meeting, the White House provided “tough feedback,” asking 
for information on alleged misinformation trends, statistics on the removal of content, and 
information on what Facebook was not removing.“ 


The next day, Facebook emailed the Biden White House to follow up on the White 
House’s “request for COVID-19 misinfo themes” that Facebook was seeing on its platform. 
Facebook told the White House that it was “removing these claims from our platforms,” 
including posts comparing COVID-19 to the flu.°© 


Following up on your request for COVID-19 misinfo themes we are seeing. All the below claims violate our 
updated Covid and vaccine misinformation policies that we announced earlier this month, and we are removing 
these claims from our platforms 


Theme 1: Vaccine Toxicity: Claims that the vaccine contains aborted fetal tissue, has microchips embedded in it 


toxic levels of aluminum, etc 


Theme 2: False Claims About Side Effects of Vaccine: Claims that vaccines will cause autism, the vaccine 
changes DNA, causes infertility, etc. 

Theme 3: Comparing the Covid Vaccine to the Flu Vaccine: That you are more likely to die after the COVID 
vaccine than after the flu vaccine 

Theme 4: Downplaying Severity of COVID-19: Claims that COVID-19 is a hoax, not any worse than the flu, etc. 


Flaherty replied, asking for more information about the prevalence of these claims and 
Facebook’s effectiveness in censoring them, stating, “Awesome. This is helpful. Can you give us 
a sense of volume on these, and some metrics around the scale of removal for each? Can you 


63 Email from Facebook personnel to Rob Flaherty (Feb. 9, 2021, 5:57 PM); see Ex. 4; Emails between White House 
staff and Facebook personnel (Feb. 18 — Mar. 1, 2021); see Ex. 5; Internal Facebook read out of a call with the 
White House and HHS (Feb. 23, 2021, 10:04 AM); see Ex. 6. 

4 Internal email between Facebook personnel (Feb. 28, 2021, 8:07 AM); see Ex. 8. 

65 Email from Facebook personnel to White House staff (Feb. 24, 2021, 7:54 PM); see Ex. 7. 

66 Td. 
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also give us a sense of misinformation that might be falling outside of your removal policies? 
Goes without saying, just because it’s on your list for removal hasn’t historically meant that it 
was removed, so I want to get a sense of the state of play here!” 


On Feb 24, 2021, at 8:41 PM, Flaherty, Robert EOP/WHO =<, who.cop.gov> wrote: 


Awesome. This is helpful. Can you give us a sense of volume on these, and some metrics around rhe scale of 
removal for each? 


Can you also give us a sense of misinformation that might be falling outside of your removal policies? 


Goes without saying, just because it’s on your list for removal hasn’t historically meant that it was removed, so | 
want to get a sense of the state of play here! 


Thanks, all 


In response, on February 28, 2021, Facebook’s Public Policy team circulated an internal 
memo to Facebook leadership, with the subject line, “FOR DECISION: White House Request on 
Covid Vaccine Misinfo Themes and Prevalence,” seeking “guidance” on “what information 
[they] could share in a Covid misinformation briefing with the White House scheduled” for 
March 1.°° In the memo, the Public Policy team explained how Facebook had already shared a 
list of recent themes that Facebook was removing, referenced Flaherty’s question about metrics 
around the “volume” and “scale of removal for each,” and further noted that the Biden White 
House had “‘a strong perception that [Facebook was] not doing enough, and we want to respond 
to their clear requests when we can.” The Public Policy team believed that “sharing some 
breakdown for prevalence of these four themes will help to build credibility with this hostile 
audience.””° 


On March 1, 2021, Facebook provided a briefing to the Biden White House on what the 
company was doing to combat COVID-related “misinformation” on its platform.”! Internal 
Facebook documents reveal that, during the briefing, Facebook “shared [its] most recent 
enforcement numbers [against misinformation] and committed to sharing this out monthly. 
Facebook also told Andy Slavitt, then-Senior Advisor for the White House’s COVID-19 
Response Team, that Facebook was “in a lockdown on Covid misinfo,” which is a “term that 
internal teams use to describe a defined time that they use to focus on a problem — in this case 
understanding what additional steps they would take on misinfo.””? Apparently, when Facebook 
mentioned that it was in a “lockdown to sprint on efforts to focus on misinfo and vaccine 
hesitancy,” it “piqued” Slavitt’s “interest,” causing him to ask “follow up questions,” such as 
“how close are you to being done? 10%? 50%?” but Facebook “did not have a good answer.””4 
While two Facebook employees noted later that “it should not have been mentioned, and asked 


9972 


67 Email from Rob Flaherty to Facebook personnel (Feb. 24, 2021, 8:41 PM); see Ex. 7. 

68 Internal email between Facebook personnel (Feb. 28, 2021, 8:07 AM); see Ex. 8. 

69 Td. 

79 Td.; see also Email from Rob Flaherty to Facebook personnel (Feb. 24, 2021, 8:41 PM); see Ex. 7. 
7 Brief: Call with White House Senior Advisor on Covid-19, at 3; see Ex. 13. 

? Td. at 5. 

B Id. 

74 Td., at 1,2, & 6. 
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[Facebook’s Public Policy team] to walk back the statement about the lockdown and not mention 
it again,” by that point, it was too late: Slavitt was already “frustrated and took this inability to 
answer as stonewalling / hiding.’ 


Following the meeting, Facebook circulated an internal recap of the call, stating that there 
was “clear frustration that we aren’t able to provide more data that demonstrates our work in this 
area.”’° The email then listed three “Specific Asks from the White House,” including for 
Facebook to provide details on its “lockdown” and “claim level data” on Facebook’s 
misinformation enforcement.””’ Facebook also noted that it “expect[ed] the White House [] to 
establish a cross-industry social media task force with the goal of setting a baseline on Covid 
misinformation and enforcement [] within the next two weeks.””® 


On March 2, a Facebook employee emailed internally, noting that he had received an 
email from the Head of the White House Office of Public Engagement “last night with feedback 
that the White House was frustrated by yesterday’s meeting, particularly around the information 
[Facebook was] providing on [its] enforcement efforts.”’? The employee also added, “we are 
hearing from Senior WH leadership that they are running out of patience with us on this subject, 
and it may cost us an opportunity to work with them constructively.”®° Another employee 
replied, “It looks like this is getting out of hand :/. Do you have a good sense of what the WH 
wants? Would it make sense [] to come up with some creative solutions?’””*! 


Facebook would meet again with the Biden White House on March 12, 2021, to discuss 
how it was approaching “borderline content,” that is, content that did not violate its policies.®” 


Our second briefing was focused on borderline content on 3/12--this session was more 
productive but Andy did not attend. Prior to this meeting we sent the CMU Covid Symptom 


Survey (executive summary sent to you as a PDF) - which we believe answers many of the 
questions that they have. We were hoping for the next follow up to be a deep dive on this 
report. 


On March 12, 2021, Facebook provided another briefing to Flaherty, explaining about 
how it was “approaching borderline COVID-related content” i.e., COVID-related content that 
did not violate its policies.*? Facebook walked through its policies and enforcement practices for 
violative and borderline content. *4 But call notes reveal that throughout the meeting, Flaherty 
continued to ask about the removal and reduction of content above all else.*° 


 Id., at2 & 6. 

7 Internal email between Facebook personnel (Mar. 1, 2021, 6:27 PM); see Ex. 9. 
T7 Td. 

8 Td. 

” Internal email between Facebook personnel (Mar. 2, 2021, 9:18 AM); see Ex. 9. 
80 Td., at 2. 

8! Internal email between Facebook personnel (Mar. 2, 2021, 10:35 AM); see Ex. 9. 
82 Brief: Call with White House Senior Advisor on Covid-19, at 2; see Ex. 6. 

83 Brief: Call with White House Senior Advisor on Covid-19, at 2; see Ex. 6. 

84 Td. 

85 Td. (emphasis added). 
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3/12 White House Meeting Notes 

HE: Know we only have 30 minutes, want to jump in. We scheduled this time to start a 
discussion to get you familiar with how we're thinking about approaching borderline 
COVID-related content. Want to have i and who run our 
proactive work on misinformation. You may remember [ij from the work we did around the 
election. !'m going to turn it over to ij to kick off. We welcome your questions at any time. If 


we have follow up, happy to schedule subsequent meetings. 


Rob: Certainly helpful — my question is in terms of reduction — what scale of reduction is 
happening. Big, big question | have is how big of a problem do you hav re? What is the 
volume of content that falls in these categories on a daily basis? How ‘Ren demoted but still 
available? We see that FB is a high news source for vaccine skeptics. 


Rob: Can | ask about downranking, efficacy of it. What does it look like before after intervention. 


Internal Facebook documents reveal that Facebook believed the March 12 meeting was 
“productive,” but tensions quickly escalated again just a few days later. Following a critical 
Washington Post article about vaccine misinformation, the White House started to berate 
Facebook’s Public Policy team. On March 15, the White House emailed Facebook’s Public 
Policy team a link to the Washington Post article with the subject line “You are hiding the 
ball.””°6 


From: Flaherty, Rob EOP/WHO <{ @who.eop.gov> 
Date: Sunday, March 14, 2021 at 11:13PM 


To: fb. com> 


Ce: Slavitt, Andrew M. EOP/WHO <i @who.cop.gov> 


Subject: You are hiding the ball 


https:/Awww.washingtonpost.com/technology/2021/03/14/facebook-vaccine-hesistancy-qanon 


Sent from my iPhone 


Slavitt also chimed into add that he “fe[It] like relative to others, interactions with 
Facebook are not straightforward and the problems are worse.”®’ He then added the vague threat: 
“Internally we have been considering our options on what to do about it.””*® 


86 Email from Rob Flaherty to Facebook personnel (Mar. 14, 2021, 11:13 PM); see Ex. 10. See also Elizabeth 
Dwoskin, Massive Facebook study on users’ doubt in vaccines finds a small group appears to play a big role in 
pushing the skepticism, THE WASH. PosT (Mar. 14, 2021). 

87 Email from Andy Slavitt to Facebook personnel (Mar. 15, 2021, 7:11 PM); see Ex. 11. 

88 Td. 
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From: Slavitt, Andrew M. EOP/WHO <i @who. cop. gov> 
Date: Monday, March 15, 2021 at 7:11 PM 
To: i <M © fb .com> 


Cc: Flaherty, Rob EOP/WHO {EE @who.eop.gov> 
Subject: Re: [EXTERNAL] Re: You are hiding the ball 


a. 

| appreciate being copied on the note. It would nice to establish trust. | do feel like relative to others, interactions 
with Facebook are not straightforward and the problems are worse— like you are trying to meet a minimum hurdle 
instead of trying to solve the problem and we have to ask you precise questions and even then we get highly 
scrubbed party line answers. We have urgency and don't sense it from you all. 100% of the questions | asked have 
never been answered and weeks have gone by 

Internally we have been considering our options on what to do about it 


Regards, 


Andy 


Facebook immediately understood the seriousness of the threat. In an internal email on 
March 16, Facebook’s Public Policy team flagged for Nick Clegg, Facebook’s President of 
Global Affairs, that the Biden White House was accusing Facebook of “hiding the ball,” lacking 
an adequate “sense of urgency” and that these concerns were “being discussed within the broader 
White House.’”®? 


This resulted in some back and forth email correspondence with where Andy and Rob 
Flaherty (White House Digital Director) explained that they felt Facebook is “hiding the ball,” 
does not have a sense of urgency around these issues, and isn’t answering their questions. They 
also offered it is being discussed within the broader White House. Last correspondence was an 
email from[fon 3/16 in the evening; and then Andy reached out to Nick directly for a 
meeting. Full email correspondence is below. 


Also March 16, Slavitt emailed Clegg directly to let him know that Slavitt was working 
with the most senior staff in the Biden White House, including Jeff Zients, today the White 
House’s Chief and at the time serving as COVID-19 Response Coordinator.””” 


Following Slavitt’s outreach, Facebook drafted an internal brief for Clegg to prepare him 
for the upcoming call with Slavitt scheduled for March 19, 2021.?! The brief recommended that 
Clegg reiterate to Slavitt that “experts have told us that removal is not always the answer,” while 


®° Brief: Call with White House Senior Advisor on Covid-19, at 2; see Ex. 13 (emphasis added). 
°° Email from Andy Slavitt to Nick Clegg (Mar. 16, 2021, 6:41 PM); see Ex. 12. 
°! Brief: Call with White House Senior Advisor on Covid-19; see Ex. 13. 
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emphasizing that Facebook had already “made unprecedented updates to [its] policies and 
enforcement tooling and [was] removing more content that [it thought] could lead to harm” in 
addition to “reducing the spread of content” that wasn’t violating Facebook’s policies but that 
Facebook thought “could lead to hesitancy.””” The brief added, “We have had ongoing 
conversations for the last year with the Biden campaign, transition, and now Administration 
around our approach to misinformation.” 


CONTEXT 
@ We have had ongoing conversations for the last year with the Biden campaign, transition, and 
now Administration around our approach to misinformation. While the campaign was focused 
mainly on enforcement of our misinfo policies, the White House is now focused on “the scope of 


the problem” of vaccine hesitancy content. They have told us in meetings that they are simply 
trying to understand what we are seeing as the scope of the problem so they can respond 
effectively. 


Later, the brief made the White House’s position even more clear: “They don’t care that 
much about our approach to amplifying authoritative info. When [one Facebook employee] 
mentioned [Facebook’s] Covid Information Center, Rob [Flaherty] audibly laughed. They feel 
the growing overabundance of misinfo outweighs and outpaces passive hub type 
offerings/product offerings.”** In other words, while Facebook tried to avoid the topic of 
censorship, focusing on ways Facebook was promoting pro-vaccine content, the Biden White 
House continually redirected its attention squarely at censoring anti-vaccine content, believing 
that was the only effective way to convince the American people to get vaccinated. 


Authoritative info 
@ They don’t care that much about our approach to amplifying authoritative info. When 


mentioned the Covid Information Center, Rob audibly laughed. They feel the growing 
overabundance of misinfo outweighs and outpaces passive hub type offerings/product offerings. 


Following the March 19, call, Clegg emailed Slavitt, providing his cell phone number and 
stating, “Plse don’t hesitate to get in touch as/when needed - it was great to make initial contact, 
and I cannot stress enough the urgency and importance which we attach to this from the top of 
the company downwards.’””° On March 19, Slavitt replied, “Thanks for the call,” and provided 
his personal cell phone number as well, adding “Look forward to follow up.”?° 


On March 21, Facebook’s Public Policy team followed up with Flaherty and Slavitt 
stating that it would work to develop and share additional data on “the most viral COVID 
vaccine-related content” on Facebook and would be implementing “additional changes that were 
approved late last week” to “reduc[e] the virality of content discouraging vaccines that does not 
contain actionable misinformation,” which, Facebook noted, “is often-true content.”’’ The next 
day, the Flaherty replied, asking Facebook a barrage of questions, including, “what interventions 


2 Id., at 1-2. 

3 Td., at 2. 

4 Td., at 6. 

5 Email from Nick Clegg to Andy Slavitt (Mar. 19, 2021, 3:24 PM); see Ex. 12. 

°° Email from Andy Slavitt to Nick Clegg (Mar. 19, 2021, 6:28 PM); see Ex. 12. 

°7 Email from Facebook personnel to White House staff (Mar. 21, 2021, 11:25 PM); see Ex. 15. 
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are being taken on ‘skepticism?’” adding that Slavitt was willing to talk to Clegg “a couple times 
per week if its [sic] necessary to get all of this.””® 


On March 24, 2021, the Center for Countering Digital Hate (CCDH), a United Kingdom- 
based non-profit, published a “report” that claimed that Robert F. Kennedy Jr. and eleven other 
individuals were responsible for 73% of all “anti-vaccine” content on Facebook.” In the report, 
CCDH strongly encouraged social media companies to remove all accounts associated with these 
twelve individuals, which CCDH dubbed the “Disinformation Dozen,” and the accounts of their 
associated organizations, entirely from their platforms.!°° By March 31, 2021, Facebook had 
determined that “most of the accounts” associated with the CCDH’s Disinfo Dozen did not 
violate its policies and would not come down under its content moderation policies. !"! 


Meanwhile, on March 26, 2021, Facebook had another call with Flaherty.'°* According to 
internal notes taken by Facebook to memorialize the call, Facebook again walked the White 
House through data on how Facebook enforced its policies. Flaherty continued to press for more 
information regarding removal as well as “tangible examples.”!™ The call notes state that 
Flaherty also asked whether Facebook was doing enough to reduce traffic from sites like the New 
York Post: “I’m curious — NY Post churning out articles every day about people dying. What is 
supposed to happen to that from Policy perspective. Does that article get a reduction, labels?”!™ 
Facebook reiterated its three-pronged approach: remove, reduce, inform. 


day about people dying: 
Does that article gefa ra 


t is supposed to happen to that from Policy perspective. 
tion, labels? 


Rob — that makes syngas ing. I’m curious — NY Post churning out articles every 


In response, Flaherty stated that rather than “inform — intellectually my bias is to kick 
people off’ Facebook, while recognizing “targeting” “people that engage with antivax content” 
may be the “path of most impact.”!° Ultimately, Facebook ended the meeting by agreeing to 
meet regularly with the Biden White House on these issues. !° 


°8 Email from Facebook personnel to White House staff (Mar. 22, 2021, 4:51 PM); see Ex. 15. 

» The Disinformation Dozen: Why Platforms Must Act on Twelve Leading Online Anti-Vaxxers, CENTER FOR 
COUNTERING DIGITAL HATE (Mar. 24, 2021), https://counterhate.com/wp-content/uploads/2022/05/2 10324-The- 
Disinformation-Dozen.pdf. 

°0 Td. In its report, CCDH labeled the following twelve individuals as the “Disinformation Dozen”: 1. Joseph 
Mercola 2. Robert F. Kennedy, Jr. 3. Ty and Charlene Bollinger 4. Sherri Tenpenny 5. Rizza Islam 6. Rashid Buttar 
7. Erin Elizabeth 8. Sayer Ji 9. Kelly Brogan 10. Christiane Northrup 11. Ben Tapper 12. Kevin Jenkins. 

°l Internal email between Facebook personnel (Mar. 31, 2021, 7:35 PM); see Ex. 20. 

2 Facebook notes from call with White House staff (Mar. 26, 2021); see Ex. 6. 
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°5 Td. (emphasis added). 

% Td. 


21 


Rob — | can go over 12:30 if you can. Gugstion on inform — intellectually my bias is 
to kick people off. Inform, intell : aybe path of most impact. How are you 


measuring impact when you d ? Is there secret sauce targeting that we can 
use? Stanford has suggested b targeting tools of people that engage with antivax 


Two days later, on March 28, Facebook emailed Flaherty, thanking him for meeting and 
following up on questions that Flaherty had about Facebook’s efforts to censor vaccine related 
content on WhatsApp.'°” On March 30, Flaherty replied, questioning whether Facebook had 
censorship on WhatsApp “under control.”!°8 


Meanwhile, on March 29, 2021, Clegg emailed Slavitt directly, stating he was told the 
meeting with “Rob Flaherty on Friday [March 26] went well. Do tell me if you hear 
otherwise”! On March 29, Slavitt replied, “I heard the same. Which is really nice given that 
things are starting to heat up on the topic. So thank you. Look forward to the follow up.”!'° 


C. April 2021: Biden White House Escalates Pressure on Facebook to Censor More 
Anti-Vaccine Content 


Facebook met with the Biden White House again on April 5, 2021.'!! Internal Facebook 
call notes reveal that, during the meeting, President Biden’s head of strategic communications 
and public engagement for COVID-19 response, Courtney Rowe, mocked rural Americans’ 
ability to determine what is true and what is not, allegedly stating, “If someone in rural Arkansas 
sees something on FB, it’s the truth.”!!? In the meeting, Facebook pointed out that it was 
“[s]eeing a trend in memes and satire making fun of individuals that don’t want to get 
vaccine.”'!? Near the end of the meeting, Facebook noted that it would start providing the Biden 
White House with “the major themes that we’re seeing each week,” from “[f]lat out, adversarial 
misinfo” to “vaccine hesitant content.”''* Two days later, an internal Facebook email stated that 
the team “may be asked to do even further policy development on vaccine hesitant entities” to 
“address the perceived ‘gaps.””!!° 


Courtney: Would be great to follow up with JJ Love that broken down by region 


and demographics. But equally important, how do we work with you all to push back on 
it. If someone in rural Arkansas sees something on FB, it’s the truth. 


°7 Email from Facebook personnel to Rob Flaherty (Mar. 28, 2021, 5:51 PM); see Ex. 16. 
°8 Email from Rob Flaherty to Facebook personnel (Mar. 28, 2021, 8:51 PM); see Ex. 17. 
° Email from Nick Clegg to Andy Slavitt (Mar, 29, 2021, 1:40 AM); see Ex. 12. 
'0 Email from Andy Slavitt to Nick Clegg (Mar, 29, 2021, 4:17 AM); see Ex. 12. 
'! Facebook notes from call with White House staff (Apr.. 5, 2021) (on file with the Comm.); see Ex. 6. 
2 Td. 
3 Td. 
14 Td. 
'S Internal email between Facebook personnel (Apr. 7, 2021, 2:35 PM); see Ex. 20. 
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Accusations from the CCDH’s Disinformation Dozen report also were proving to be a 
challenge, even though some of the entities “were completely benign” according to Facebook’s 
internal assessment.'!* At the time, Facebook understood that vaccine hesitancy is not the same 
as misinformation. !!’ 


From: GS ~/0= THE FACEBOOK/OUFEXCHANGE ADMINISTRATIVE GROUP (FYDIBOHF23SPDLT)/CNeRECIPIENTS 
CN=801D8F2FABOF4236A38CD9150799E9DE 

To: 

Sent: 4/7/2021 5:44:31 PM 

Subject: Re: Top Entities / Enforcement 


Thanks for the heads up; | obviously agree with all of this. There is an underlying assumption that all of these entities are bad (and some of them are, I'm 
sure) but even some of the 38 Disinfo Dozen entities were completely benign. To really push farther than what we have already done would likely be out 
of the misinfo reaim, since vaccine hesitancy is often or mostly not misinfo. A few ideas that come to mind 

e Major change to DVDE: Only require 1 CS strike and lower the amount of B2V required 

e DVDE but without any CS strike requirement 

e Make B2V part of the Community Standards 


The last one is the nuclear option but also the one most likely to have a meaningful impact 


On April 9, 2021, Facebook emailed the Biden White House, explaining the ways in 
which it was already working to limit the virality of certain vaccine-related content on its 
WhatsApp platform.!!® Facebook also emphasized that Facebook would continue “to design 
further product features that limit virality [of COVID and vaccine-related information] on 
WhatsApp.”!!? Later that day, Flaherty replied, “In the electoral context, you tested and deployed 
an algorithmic shift that promoted quality news and information about the election. This was 
reported in the New York Times and also readily apparent to anyone with cursory social 
listening tools. You only did this, however, after an election that you helped increase skepticism 
in, and an insurrection which was plotted, in large part, on your platform. And then you turned it 
back off. J want some assurances, based in data, that you are not doing the same thing again 
here.”'*° Facebook replied that the company understood. '”! 


On April 13, 2021, Nick Clegg emailed Andy Slavitt following news that Centers for 
Disease Control and Prevention (CDC) and Food and Drug Administration (FDA) recommended 
that states pause using the Johnson & Johnson vaccine, stating, “Re the J+J news, we’re keen to 
amplify any messaging you want us to project about what this means for people — it obviously 
has the risk of exacerbating vaccine hesitancy, so we’re keen to get ahead of the knock-on effect. 
Don’t hesitate to tell me — or via your teams — how we can help to provide clarity/reassurance via 
Facebook.”!”* Facebook’s Public Policy team also forwarded Clegg’s email to Flaherty and 
Courtney Rowe, noting that Facebook wanted “to make sure we are amplifying the right 
messages.”!”? In response, on April 13, Flaherty asked Facebook staff for a “commitment from 


'6 Internal email between Facebook personnel (Apr. 7, 2021, 5:44 PM); see Ex. 20. 

"" Td. 

'8 Email from Facebook personnel to Rob Flaherty (Apr. 9, 2021, 11:15 AM); see Ex. 21. 

19 Td. 

20 Email from Rob Flaherty to Facebook personnel (Apr. 9, 2021, 2:56 PM); see Ex. 22 (emphasis added). 
21 Email from Facebook personnel to Rob Flaherty (Apr. 10, 2021, 2:33 PM); see Ex. 22 (emphasis added). 
2 Email from Nick Clegg to Andy Slavitt (Apr. 13, 2021, 9:18 AM); see Ex. 12. 

3 Email from Facebook personnel to White House staff (Apr. 13, 2021, 12:21 PM); see Ex. 24. 
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[Facebook] to make sure that a favorable review reaches as many people as the pause, either 
through hard product interventions or algorithmic amplification.” !4 


The Biden White House Pressured Facebook to Censor Critics of the Biden Administration, 
Including Tucker Carlson, Tomi Lahren, and Other Conservative Media 


On April 14, 2021, Facebook had a call with the Biden White House.!”° Prior to the call, 
Slavitt emailed Clegg about a video that journalist Tucker Carlson had released the night before 
questioning whether COVID vaccines were safe and effective, stating, “Number one on 
Facebook. Sigh. Big reveal call with FB and WH today. No progress since we spoke. Sigh.”!”° 

Internal meeting notes reveal that Facebook understood that the White House wanted 
“empirical information regarding success of interventions”—that is, data on the effectiveness of 
Facebook’s censorship.'*’ Indeed, in the meeting, Flaherty explained to Facebook that, “We have 
to explain to President [Biden], Ron [Klain, White House Chief of Staff], people, why there is 
misinfo on the internet, bigger problem than FB.”!78 


on the internet, bigger problem than FB. Where i re, what interventions are, how 


Rob: Three things. We have to explain to wher : n, people, why there is misinfo 
well they are working, for products, want to e = ings that you know to be 


effective. | don’t even care about specific method@logy, you have better, richer data 
than we’ll ever have. What are the thing - jng hesitancy on your platform? What is 


it? How big is the problem? When y intervening, how are you measuring success? 
| say these things because candid e isnot a lot of trust towards FB, | need to know 
what theory of the case is, wher@we be most effective. | am, personally, nervous, 
reported that there are interverttions that have been done in other contexts, like NEQ 
score, that have been pulled 2 Want to make sure that you’re not finding things 
that are effective that 


At one point in the meeting, Flaherty asked Facebook about the “material impact” of 
“chang[ing] the algorithm so that people were more likely to see NYT, WSJ, any authoritative 
news source over Daily Wire, Tomi Lahren, polarizing people.’”!”’ 


Rob: If you were to change the algorithm so that people were more likely to see NYT, 


WSJ, any authoritative news source over Daily Wire, Tomi Lahren, polarizing people. 
You wouldn’t have a mechanism to check the material impact? 


During the meeting, Facebook also explained how it was “actively pushing to remove” 
the Disinformation Dozen from its platform.!*° But later in the meeting, Flaherty began to grow 


4 Email from Rob Flaherty to Facebook personnel (Apr. 14, 2021, 1:33 PM); see Ex. 24. 

5 Email from Nick Clegg to Rob Flaherty (Apr. 14, 2021, 10:52 AM); see Ex. 24. 

26 Email from Andy Slavitt to Facebook personnel (Apr. 14, 10:01 AM); see Ex. 28 (emphasis added); see Tucker 
Carlson Tonight, FACEBOOK (Apr. 13, 2021), https://www.facebook.com/watch/?v=1 1457735525 14245. 

27 Facebook notes from call with White House staff (Apr. 14, 2021); see Ex. 6. 
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impatient, stating, “I feel like we’re running around in circles. [] This feels like we’re chasing 
our tails. If you don’t want to give information, just say that. I don’t want to feel like I’m going 
to a dog and pony show. My dream is for FB to play ball. It’s about will we get out of this 
f***king mess.”!?! 


Rob: | feel like we’re running around in circles. Some partners give us lots of 
information, some partners tell us to fuck right off. This feels like we’re chasing our 
tails. If you don’t want to give information, just say that. | don’t want to feel like I’m 
going to a dog and pony show. My dream for FB to play ball. It’s about will we get out 


of this fucking mess. I’m not doubting that you are sincerely trying to solve this problem 
in good faith. I’m doubting that you are telling us everything or that you Lindsay aren’t 
getting the resources you need to tackle this. Of 1% of vaccine info, this is what’s 
concerning, this is who is seeing it, this is what we're doing. 


Following the meeting, on April 14, 2021, Flaherty, copying Slavitt, emailed Facebook 
demanding to why Facebook had allowed videos by Tomi Lahren and Tucker Carlson to become 
the top posts about vaccines on Facebook for two consecutive days, adding, “This is exactly why 
I want to know what ‘Reduction’ actually looks like — if ‘reduction’ means ‘pumping our most 
vaccine hesitant audience with tucker Carlson saying it doesn’t work’ then . . . I’m not sure it’s 
reduction!”!32 


From: Flaherty, Rob EOP/WHO <_E @who.eop.gov> 
Sent: Wednesday, April 14, 2021 1:10:41 PM 
To: i @fb.com> 


Ce: Slavitt, Andrew M. EOP/WHO EEE who.eop.gov> 
Subject: tucker 


Since we've been on the phone — the top post about vaccines today is tucker Carlson saying they don't work. 


Yesterday was Tomi Lehren saying she won't take one. This is exactly why | want to know what “Reduction” actually 
looks like — if “reduction” means “pumping our most vaccine hesitant audience with tucker Carlson saying it doesn't 
work" then...I'm not sure it's reduction! 


Rob Flaherty 

Director of Digital Strategy 
The White House 

Cl) 


That evening, Nick Clegg sent a follow-up email to Andy Slavitt, stating, “Hi Andy - 
have looked into this some more. I realize it may be of limited comfort at this moment, but this 
was not the most popular post about vaccines on Facebook today. Our data is slightly lagging, 
and we’ll get back to you with more detail on this specific post tomorrow. Right now, it appears 
that it probably was among the top 100 most-viewed vaccine posts. I’m including a few 
examples of posts that were more popular today at the end of this note,” which just happened to 
be posts by CNN, ABC, NBC, the New York Times, the CDC, CBS, and Heather Cox 
Richardson, an outspoken proponent of Joe Biden.!*? Clegg continued, “Regardless of 


131 Tq. (emphasis and asterisks added). 

'32 Email from Rob Flaherty to Facebook personnel (Apr. 14, 2021, 1:10 PM); see Ex. 25. 

'33 Email from Nick Clegg to Andy Slavitt (Apr. 14, 2021, 10:51 PM); see Ex. 28; see David Smith, ‘4n end of 
American democracy’: Heather Cox Richardson on Trump’s historic threat, THE GUARDIAN (Oct. 7, 2023). 
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popularity, the Tucker Carlson video does not qualify for removal under our policies. Following 
the government’s decision yesterday, we are allowing claims that the Johnson and Johnson 
vaccine causes blood clots, but we still do not allow categorical claims that it or other vaccines 
are unsafe or ineffective. That said, the video is being labeled with a pointer to authoritative 
COVID information, it’s not being recommended to people, and it is being demoted.”'!*4 
Facebook staff then forwarded Clegg’s email to Flaherty. !*° 


From: Nick Clegg <f@fb.com> 

Date: Wednesday, April 14, 2021 at 10:51 PM 

To: Slavitt, Andrew M. EOP/VWWHO ii IQ who.ecop.gov> 
Cc: 2) fb. com> 


Subject: Re: Tucker Carlson anti-vax message. 
Hi Andy - have looked into this some more. 


| realize it may be of limited comfort at this moment, but this was not the most popular post about vaccines on 
Facebook today. Our data is slightly lagging, and we'll get back to you with more detail on this specific post 
tomorrow. Right now, it appears that it probably was among the top 100 most-viewed vaccine posts. I’m including 
a few examples of posts that were more popular today at the end of this note. 


Regardless of popularity, the Tucker Carlson video does not qualify for removal under our policies. Following the 
government's decision yesterday, we are allowing claims that the Johnson and Johnson vaccine causes blood 
clots, but we still do not allow categorical claims that it or other vaccines are unsafe or ineffective. 


That said, the video is being labeled with a pointer to authoritative COVID information, it’s not being recommended 
to people, and it is being demoted. 


The team is working on the follow ups from the meeting this morning, including more details on most 


viewed/ranked content on Facebook andIwill be in touch shortly on that - I'm v keen that we follow up as we'd 
agreed, and | can assure you the teams here are oniit. 


Given the timeline that was provided today for further decision about the J&J vaccine, it would be great to get your 
guidance about what affirmative messages we should amplify right now. Consistent with the message we heard at 


the press conferences, we're currently emphasizing the safety and efficacy of the Modema and Pfizer vaccines in 
the Covid Information Center. 


Popular Vaccine-Related Content on Facebook Today: 


CNN: =https:/Awww.cnn.com/202 1/04/13/health/blood-clots-johnson—johnson-vaccine-wellness/index.html< 
ABC: >https://Awww.facebook.com/10160902498218812< 

NBC: >https:/Awww.nbcnews.com/health’/health-news/what-do-if-you-got-johnson-johnson-vaccine-n1263927 < 
NY Times: >https://www.nytimes.com/2021/04/13/us/politics/johnson-johnson-vaccine-blood-clots-fda-cdc.html< 
CDC: >https:/Awww.fac com/101 

CBS: >https:/Avww.facebook.com/10159467409732010< 

Heather Cox Richardson: >https:/Avww.facebook.com/29736337 1758902< 


Ally best 


Nick 


In his reply later that evening, Flaherty stated, “I guess this is a good example of your 
tules in practice then — and a chance to dive in on questions as they’re applied. How was this 
not violative? The second half of the segment is raising conspiracy theories about the 
government hiding that all vaccines aren’t effective. It’s not about just J&J. What exactly is the 
tule for removal vs demoting? Moreover: you say reduced and demoted. What does that mean? 


134 Iq. 
135 Email from Facebook personnel to Rob Flaherty (Apr. 14, 2021, 8:11 PM); see Ex. 26. 
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There’s 40,000 shares on the video. Who is seeing it now? How many? How effective is 

that? And we’ve gone a million rounds on this in other contexts so pardon what may seem like 

deja vu — but on what basis is ‘visit the covid-19 information center for vaccine resources’ the 
best thing to tag to a video that says the vaccine doesn’t work? Not for nothing but last time we 
did this dance, it ended in an insurrection.” !*° 


On Apr 14, 2021, at 11:29 PM, Flaherty, Rob EOP/VVHO (EE @who.cop.gov> wrote: 


| guess this is a good example of your rules in practice then — and a chance to dive in on questions as they're 
applied 


How was this not violative? The second half of the segment is raising conspiracy theories about the government 
hiding that all vaccines aren't effective. It's not about just J&J. What exactly is the rule for removal vs demoting? 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. Who is 
seeing it now? How many? How effective is that? 


And we've gone a million rounds on this in other contexts so pardon what may Seem like deja vu — but on what 
basis is “visit the covid-19 information center for vaccine resources” the best thing to tag to a video that says the 
vaccine doesn't work? 


Not for nothing but last time we did this dance, it ended in an insurrection 


Internal Facebook documents reveal that shortly thereafter Facebook employees 
exchanged emails, stating, “I find this kind of harassment from White House staff to be terribly 
galling, but useful to understand their perspective on us clearly.” !°7 


@ib.cornl, Kevin Mastin 


ent: hur 4/ 1are0e2 (U1C-07; 
Subject; Re: [EXTERNAL] FY: Tucker Carlson anti-vax message 


Open question whether it'« helpful or hannful for me to have to read them too, I find this land of hamesment from Whate 
House staff to be terribly gallmg, but useful to uuderstand them perspective on us clearly 


Two days later, on April 16, 2021, Flaherty sent another email to Facebook staff, 
appearing to express his impatience with Facebook’s delay in response, stating, “These questions 
weren’t rhetorical.” !*8 


A few days later, on April 21, 2021, Facebook’s Public Policy team sent Flaherty a long 
email, replying to each of Flaherty’s questions, including explaining why Facebook only 
demoted Tucker Carlson’s post rather than remove it.!*? In response to Flaherty’s question, 
“How was the Tucker post not violative?” Facebook staff replied, “while we remove content that 
explicitly directs people not to get the vaccine, as well as content that contains explicit 
misrepresentations about vaccines, we reviewed this content in detail and it does not violate 


136 Email from Rob Flaherty to Facebook personnel (Apr. 14, 2021, 11:59 PM); see Ex. 28. (emphasis added). 
'37 Tnternal email between Facebook personnel (Apr. 15, 2021, 10:23 AM); see Ex. 74. 

138 Email from Rob Flaherty to Facebook personnel (Apr. 16, 2021, 4:37 PM); see Ex. 28. 

139 Email from Facebook personnel to Rob Flaherty (Apr. 21, 2021, 2:01 PM); see Ex.28. 
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those policies.”!*° In response to Flaherty’s question about what Facebook meant by “reduced 
and demoted” and how effective those measures were given that the video had already received 
“40,000 shares,” Facebook staff replied, “The video received 50% demotion for seven days while 
in the queue to be fact checked, and will continue to be demoted even though it was not 
ultimately fact checked.”'*! 


From: GR </0=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 

To: Flaherty, Rob EOP/WHO 

Sent: 4/21/2021 2:01:51 PM 

Subject: Re: [EXTERNAL] FW: Tucker Carlson anti-vax message 


Rob—thanks for catching up earlier and sorry for the delay in getting these back to you. We can schedule time to 
discuss any of this further if helpful. 


How was the Tucker post not violative? 
e while we remove content that explicitly directs people not to get the vaccine, as well as content that contains 
explicit misrepresentations about vaccines, we reviewed this content in detail and it does not violate those 
policies. 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. Who is 
seeing it now? How many? How effective is that? 
e The video received 50% demotion for seven days while in the queue to be fact checked, and will continue to 
be demoted even though it was not ultimately fact checked. 


The Biden White House Pressured Facebook to Censor A “Vaccine Discouraging” Meme 


Clegg testified to the Committee that sometimes the White House would request, during a 
phone call with Facebook, that the platform remove specific pieces of content: 


They would provide specific examples. And as part of a back-and-forth, we 
would definitely receive questions about, why did you not remove this content, 
why did you not remove that content? So it wasn't just a generic or general 
theoretical discussion. It was sometimes quite a granular discussion about 
specific posts. !* 


Once such example of the Biden White House requesting specific content be removed 
from Facebook occurred in mid-April 2021. On April 16, 2021, Clegg emailed Slavitt to provide 
nonpublic information about the vaccine-related content that Facebook was seeing on its 
platform “as well as the interventions” it was “deploying to counter misinformation,” adding that 
the company did not normally share this type of data but “took [the Biden White House’s] cue 
the other day that it was important to get this to [the Biden White House] quickly even if not 


140 Td. 

141 Td. 

'42 House Judiciary Committee’s Transcribed Interview of Nick Clegg (Mar. 1, 2024), at 21-22 (on file with the 
Comm.). 
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polished.”’!*? Clegg also noted that it did not yet have “a specific answer on the [Biden White 
House’s questions about the] Tucker Carlson post.”!44 


On April 18, 2021, Clegg informed his team at Facebook that he just “got off [an] hour 
long call with Andy Slavitt,” in which Slavitt told Clegg that he had “attended a meeting of 
misinfo researchers (didn’t provide names) organized by Rob F [Flaherty] on Friday in which the 
consensus was that FB [Facebook] is a “disinformation factory”, and that YT [YouTube] has 
made significant advances to remove content leading to vaccine hesitancy whilst we [Facebook] 
have lagged behind.”'* Clegg then informed his team that Slavitt “was outraged — not too strong 
a word to describe his reaction — that [Facebook] did not remove” a particular post—a Leonardo 
DiCaprio meme— “which was third most highly ranked post in the data set [Facebook] sent to 
him.” 


., Trnothy McComas 
‘ Apri 4, 2021 


UH OH Hl 


10 years from now you will 
be watching TV and hear... 


Did you or a loved one 
take the covid vaccine? 


hI 
on Share 


'43 Email from Nick Clegg to Andy Slavitt (Apr. 16, 2021, 9:07 PM); see Ex. 30. 
144 Iq. 
'45 Email from Nick Clegg to Facebook personnel (Apr. 18, 2021, 9:07 PM); see Ex. 29. 
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2 comments 385K shares 


Clegg “countered that removing content like that would represent a significant incursion 
into traditional boundaries of free expression in the US but he [Slavitt] replied that the post was 
directly comparing Covid vaccines to asbestos poisoning in a way which demonstrably inhibits 
confidence in Covid vaccines amongst those the Biden Administration is trying to reach.” In 
other words, Slavitt disregarded Clegg’s warning that removing a meme about vaccine side 
effects would likely violate the First Amendment.'*’ Clegg later testified to the Committee that 
about this call with Slavitt: “And it seemed to me obvious that if Big Tech platforms were to start 
acting against what was clearly satire, humor, facetiousness online, I mean, it would set a pretty 
significant precedent.” !4° Clegg concluded by telling his team that, “Given what is at stake here, 
it would be a good idea if we could regroup to take stock of where we are in our relations with 
the WH [White House], and our internal methods too.”!*” 


In testimony before the Committee, Clegg testified that “[the White House] certainly 
urged us to take down content and pointed out content which they felt should have been 
removed,” and that the White House’s requests for more to be removed were “‘a pretty persistent 
thing” and “at the heart of” most of the calls.!°° 


146 Td. 

147 Td. 

'48 House Judiciary Committee’s Transcribed Interview of Nick Clegg (Mar. 1, 2024), at 30 (on file with the 
Comm.). 

‘49 Email from Nick Clegg to Facebook personnel (Apr. 18, 2021, 9:07 PM); see Ex. 29. 

'50 House Judiciary Committee’s Transcribed Interview of Nick Clegg (Mar. 1, 2024), at 34, 65-66 (on file with the 
Comm.). 
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From: Nick Clegg J of com> 
Sent: Sunday, April 18, 2021 9:07:34 PM 


Cc: Joel Kaplan ; ; ; @fb.com>, 
@fb.com> 


Subject: A/C PRIV White House/Covid 


Just got off hour long call with Andy Slavitt, There are some pretty serious — and sensitive (see last point) - issues we need to 


address. A SUMAN: wTiAL TREATMENT REQUESTED META-1 18HUC-0063332 
NOT FOR DISTRIBUTION 
MEMBERS & STAFF ONLY 


* He was appreciative of the data we sent thru on Friday, and confirmed that Rob F had said that they had never received so 
much data from us before, 


* Andy attended a meeting of misinfo researchers (didn't provide names) organized by Rob F on Friday in which the 
consensus Was that FB is a “disinformation factory”, and that YT has made significant advances to remove content leading to 
vaccine hesitancy whilst we have lagged behind. 

* Whilst appreciative of our emphasis on authoritative vaccine, the principal focus for Andy S and his team in the coming 
weeks is to reach the “hardest to reach” people who have a propensity to consume vaccine hesitant related content and who 
are not swayed by official/authoritative sources of content, Our systems, he believes — as confirmed by the researchers — 


feed vaccine hesitant related contant ta pockets of the population and that’s the problem he wants our help to resolve. 

* Asan eg, he was outraged — not too strong a word to describe his reaction — that we did not remove this post which was 
third most highly ranked post in the data set we sent to him: 
https://www.facebook.com/td.mccomas/posts/4106421952731017 | countered that removing content like that would 
represent a significant incursion into traditional boundaries of free expression in the US but he replied that the post was 
directly comparing Covid vaccines to asbestos poisoning in a way which demonstrably inhibits confidence in Covid vaccines 
amongst those the Biden Administration is trying to reach. [It would be very helpful if someone could pise check whether this 
content was also available on YT — Andy's assumption is that YT would never accept something like this] 

* V worryingly, towards the end of the conversation, Andy told me in confidence — so please treat it as such —that internal 
FB employees are leaking to his team (I assume via Rob F) accounts of disobliging remarks made about both Andy and Rob by 
FB decision makers. Further, that those remarks are coupled with suggestions about how FB should “snow” the White House 
with info/data about authoritative Covid info in order not to share the most telling/helpful data about content which 
contributes to vaccine hesitancy. We then discussed the wider issue of trust — or the lack of it — between FB and the Biden 
team related to the events during the election and beyond, but needless to say | was shocked and embarrassed that 
somehow we are perceived to be behaving so unprofessionally. 


We concluded that he would ask Rob F to share the data and policy recommendations from the researchers with us asap so that 
we could give a considered reply on further steps we may/may not be able to take. We agreed to speak again once that assessment 
has been made, 


Given what is at stake here, it would also be a good idea if we could regroup to take stock of where we are in our relations with the 
WH, and our internal methods too, 


In response, Facebook’s Public Policy team raised the concern that Slavitt’s “challenge 
[felt] very much like a crossroads for us with the [Biden] White House in these early days.”’!>! 
Another member of Clegg’s team, added, “Clearly we have a policy viewpoint gap with [the 
White House] we need to figure out perspectives on — what we believe violates and what they 
think does,” adding that Facebook need to “get to a common ground on what [it was] doing on 
substance.”!*? Clegg then replied, agreeing that Facebook needed to “identify the gaps” between 
the White House’s “views and [its] policies” and “see what further steps [it could] take.”!™ 


15! Email from Facebook personnel to Nick Clegg (Apr. 18, 2021, 7:05 PM); see Ex. 29. 
152 Email from Facebook personnel to Nick Clegg (Apr. 18, 2021, 7:30 PM); see Ex. 29. 
153 Iq 
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Sent: Sunday, April 18, 2021 7:05 PM 


C PRIV White House/Covid 


Thanks Nick. This is obviously very satay to read. Rob made an offhand comment about conversations with “other people 
from Facebook” during a recent conversation, this is clearly what he was referencing. Because of his history in the digital campaign 
world, it’s not surprising that he’d have relationships with some of our employees. It’s disheartening and unfortunately no longer 
surprising to read that our colleagues would portray our conversations this way. | haven’t been part of any conversation that 
includes disparaging remarks made about Andy, or about any strategy to snow the White House — the only disparaging remarks 
I've heard people make on our calls have been in reference to the disrespectful tone Rob uses with employees at Facebook. 


All of that said—Andy’s challenge feels very much like a crossroads for us with the White House in these early days. 


Date: Sunday, April 18, 2021 at 7:30 PM 


@fb.com>, Nick Cle @fb.com>, @fb.com> 
F @fb.com>, @fb.com>, 


Subject: RE: A/C PRIV White House/Covid 
AC PRIV: 


As frustrating as these fake leaks and innuendo are (and they are!), my thoughts are that we should not let that distract us from 
the real issues here, which are the substance. Clearly we have a policy viewpoint gap with them we need to figure out perspectives 
on — what we believe violates and what they think does... and the belief that YT is doing better than us, which | find so hard to 
believe. Probably best to spend our effort here and not get sucked into this other thread. 


At the end of the day, unless we get to a common ground on what we’re doing on substance, the rest doesn’t really matter. 


@fb.com]; (@fb.coml 
@fb.com]: @fb.com]; i 


= OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT WCN=RECIPIENTS/CN=NCLEGGE6E] 

Sent: Mon 4/19/2021 9:40:45 AM (UTC-07:00) 

Subject: Re: A/C PRIV White House/Covid 


Yep that is of course right: identify the gaps in their views and our policies (incl via feedback from the researchers they've been 
listening to); identify whether there really are such significant gaps between our approach and YT’s; see what further steps we can 


take. 


N 


On April 23, 2021, Clegg followed up with Slavitt to address the Biden White House’s 
“wider questions about whether [Facebook was] drawing the lines re what is removed and/or 
demoted in the right place,” noting that it was “looking at options” and would “reach out again 
as/when” it had “worked up new proposals.”!*4 


The same day, Flaherty sent Facebook staff an email with the subject line “Research 
Suggestions” that included a document entitled “Facebook COVID-19 Vaccine Misinformation 
Brief” that Flaherty stated was “circulating around” the White House “and informing 
thinking.”'*° Flaherty cautioned Facebook, “Don’t read this as White House endorsement of 


‘54 Email from Nick Clegg to Andy Slavitt (Apr. 23, 2021, 3:50 PM); see Ex. 30. 
'55 Email from Rob Flaherty to Facebook personnel (Apr. 23, 2021, 2:27 PM); see Ex. 30. 
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these suggestions (or, also, as the upper bound of what our thoughts on this might be). But — 
spirit of transparency — this is circulating around the [White House] building and informing 
thinking.”!°° The document had two major headings: “Facebook plays a major role in the spread 
of COVID vaccine misinformation” and “Facebook’s policy and enforcement gaps enable 
misinformation’s spread.”!*’ Under each heading, the document listed multiple bullet points 
detailing perceived problems with Facebook’s COVID-related censorship efforts, including 
“Non-English mis/disinformation circulating without moderation (Spanish, Arabic, Chinese, 
among others)” and how people censored on one Facebook account may still be able to speak 
freely on another account or “another Facebook owned platform like Instagram.”!* 


On April 27, 2021, Clegg emailed Slavitt, noting that Facebook had “received the 
recommendations/observations from the research organizations you met re covid misinfo etc this 


afternoon — the teams are now looking at them carefully, and I'll get back to you once that’s 
done.” >? 


Following Clegg’s call with Slavitt on April 18, Facebook employees began preparing a 
draft memo to Mark Zuckerberg about the “continued pressure” from the Biden White House to 
remove “more COVID-19 vaccine discouraging content,” and to remove “entities that are seen to 
be contributing to a large amount of vaccine misinformation content,” i.e., the Disinfo Dozen, 
even though the Facebook employees did “not believe we currently have a clear path for 
removal.”!® 


On April 28, 2021, a Facebook employee circulated the draft memo for Facebook CEO 
Mark Zuckerberg and COO Sheryl Sandberg, writing: ““We are facing continued pressure from 
external stakeholders, including the [Biden] White House . . . to remove more COVID-19 
vaccine discouraging content. For example, we recently shared with the White House a list of the 
top 100 vaccine-related posts on FB [Facebook] in the U.S. for the week of 4/5-4/11. While 
authoritative information dominated the list, the White House was concerned that the #3 post 
was a vaccine discouraging humorous meme, and they called on us to delete the meme. We 
didn’t appropriately catch-and-demote this meme (and it shouldn’t be removed as it’s 
humorous/satirical and arguably true). Still, this incident prompted us to take another hard look 
at our approach and to seek your guidance on whether to take more aggressive action against 
certain vaccine discouraging content.”!°! 


156 Td 

157 Td. 

158 Tq 

'59 Email from Nick Clegg to Andy Slavitt (Apr. 27, 2021, 12:11 AM); see Ex. 20. 

160 Internal emails between Facebook personnel (Apr. 2021); see Ex. 31. 

‘6! Internal email between Facebook personnel (Apr. 28, 2021, 4:27 PM); see Ex. 31. (emphasis in original). 
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Subject: [For Decision] Vaccine discouraging content 


Mark, Sheryl: 


We are facing continued pressure from external stakeholders, including the White House and 
the press, to remove more COVID-19 vaccine discouraging content. For example, we recently 


week of 4/5-4/4 1. While authoritative information dominated the list, the White House was 
concerned that the #3 post was a vaccine discouraging humorous meme, and they called on us 
to delete the meme. We didn't appropriately catch-and-demote this meme (and it shouldn't be 
removed as it's humorous/satirical and arguably true). Still, this incident prompted us to take 
another hard look at our approach and to seek your guidance on whether to take more 
aggressive action against certain vaccine discouraging content. 


Options included: 
= 25% demotion (which was the current plan) 
= 50% or stronger demotion (they said maybe even 80%) if 50% “isn’t 
sufficient to keep such content out of top vaccine posts” 
= Remove the content!” 


We also continue to see pressure from partners and policymakers, including the White House, 
to remove entities that are seen to be contributing to a large amount of vaccine misinformation 
content (commonly referred to as the “disinformation dozen” which CCDH asserts are 
responsible for 73% of vaccine misinformation on Facebook). These “disinformation dozen” are 
linked to 34 accounts across Facebook and Instagram. We have reviewed these entities and 
determined that 6 accounts violate our policies and will be removed. We continue to review 
these entities on our platforms, but the remaining accounts do not currently violate our policies - 
including our Dedicated Vaccine Discouraging Entities (DVDE) policy. We believe that these 
entities understand our policy lines clearly and are careful not to post content that goes beyond 
these, but rather direct followers and group members to off platform entities where they share 
more overt vaccine misinformation. We also believe that some of the more high profile entities 
changed their behavior since our larger takedowns earlier this year, and have stopped posting 
vaccine misinformation (e.g., RFK’s Jr.'s Page). We continue to monitor these entities on 
platform, and are reviewing the off platform activities as well, but do not believe we currently 
have a clear path for removal of these. 


D. July 2021: Biden White House Pressure Campaign Reaches a Fever Pitch 


The pace of communications between Facebook and the White House slowed somewhat 
during May and June of 2021.'® On May 26, 2021, Facebook stopped censoring lab-leak 
theory.'™ In early July, top Facebook officials, including Clegg, engaged directly with the 
Surgeon General’s Office about alleged misinformation.'® But the situation began to rapidly 
change in mid-July. 


On July 14, 2021, the Eric Waldo of the Surgeon General’s office informed Facebook 
that Surgeon General Vivek Murthy would be releasing an “Advisory” the following day “about 


162 Tq. 

163 See generally May and June email chains between Facebook personnel and White House staff; see Ex. 32, 37, 40, 
41, 43, 44, 45, & 46. 

‘64 Tnternal email from Facebook personnel to Mark Zuckerberg (June 6, 2021, 2:24 PM); see Ex. 37. 

165 See, e.g., Email from Surgeon General’s office personnel to Facebook personnel (July 6, 2021, 9:47 AM); see 
Ex. 50. 
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the importance of addressing health misinformation” and expected to regularly connect with 
Facebook “about this and more” in the future.'® In a follow-up email on the same day, the 
Surgeon General’s Office informed Facebook that “the Advisory notes that technology 
companies and social media organizations have a role to play in product and policy design to 
help slow the spread of health misinformation.”!°’ 


July 15, 2021: Surgeon General’s Advisory released 


On July 15, 2021, the Surgeon General’s office emailed Facebook, highlighting the 
Advisory and Surgeon General Vivek Murthy’s statements that “American lives are at risk” 
unless social media companies “do more to address the spread [of misinformation] on their 
platforms.”'®® The same day, then-White House press secretary Jen Psaki held a joint press 
briefing with Surgeon General Murthy and criticized “Facebook specifically for [its] handling of 
COVID misinformation and listed four steps” the White House believed Facebook should be 
taking, citing CCDH’s claim that “12 people’”—that is, the so-called Disinformation Dozen— 
were “producing 65 percent of anti-vaccine misinformation on social media platforms” and 
noting that it was “important to take faster action against harmful posts.”!® 


Following these statements, Facebook scrambled to determine whether the so-called 
Disinformation Dozen had been “totally removed” from its platforms, with one employee noting 
that “The White House made a statement about these accounts and now leadership is interested 
in what the status is, we’d like to do this now if at all possible.”'’° (Following its review, 
Facebook “identified 39 accounts that are owned by, or appear to be linked to, the Disinfo 
Dozen,” of which 15 had been disabled, four were “experiencing feature blocks,” 10 were in 
“non-rec status,” and the remaining accounts had not posted “sufficient violating content” 
recently to be disabled or incur penalties.)'7' Meanwhile, other Facebook employees emailed 
internally, noting that the Biden Administration’s definition of “misinformation” was 
“completely unclear,” and that it “seems like when the vaccination campaign isn’t going as 
hoped, it’s convenient for them to blame us.”!”? Another added that the Biden White House’s 
response seemed like “a political battle . . . not fully grounded in facts, and it’s frustrating.”!”° 


66 Email from Eric Waldo to Nick Clegg and other Facebook personnel (July 14, 2021, 5:21 PM); see Ex. 50. 
67 Td. 
68 Email from Eric Waldo to Nick Clegg and other Facebook personnel (July 15, 2021, 9:08 AM); see Ex. 50. 
® Internal email from Facebook personnel to Nick Clegg (July 15, 2021, 4:21 PM); see Ex. 54; Press Briefing by 
Press Secretary Jen Psaki and Surgeon General Dr. Vivek H. Murthy, July 15, 2021, THE WHITE HOUSE. 
7 Internal text thread between Facebook personnel (July 15, 2021); see Ex. 75. 
Tl Td. 
® Internal email among Facebook personnel (July 16, 2021, 7:32 PM); see Ex. 54. 
® Internal email among Facebook personnel (July 16, 2021, 8:14 PM); see Ex. 54. 
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From: <0. = THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=8A70307919154AF59F82CFF2CE7AD656> 

To: HE MisinfoPolicyTeam 

Sent: 7/16/2021 8:14:12 PM 

Subject: Re: Biden Admin Health Misinfo Advisory 


| agree. This seems like a political battle that's not fully grounded in facts, and it's frustrating. That said, there’s 
good momentum intemally right now to get even deeper on the data so we can push back more directly, so 
hopefully we'll have a bit more to say on this soon 


On July 15, 2021, the Biden White House also emailed Facebook about technical issues 
that had been affecting follower growth on President Biden’s Instagram account (Wpotus). When 
a Facebook employee replied that he was unable to explain the internal technical issue but noted 
that it had been “resolved and should not happen again,” Rob Flaherty replied in a tone familiar 
to Facebook personnel, “Are you guys f***ing serious? I want an answer on what happened here 
and I want it today.”!”4 


From: "Flaherty, Rob R. EOP/WHO" <(GE @who.cop.gov> 

Date: Thursday, July 15, 2021 at 3:29 PM 

To: " © OP/VVHO" ED Who.cop.gov>, ms (1G )" 
(> .con>, 3) .com> 


Subject: RE: Follow up on WH questions 


Are you guys fucking serious? | want an answer on what happened here and | want it today. 


July 16, 2021: President Biden says that Facebook is “killing people” 


On July 16, 2021, Facebook met with the Surgeon General’s office to discuss the 
advisory the Surgeon General had announced publicly the day before.'’ Prior to the meeting, 
Facebook emailed internally about how CCDH’s Disinformation Dozen report was both flawed 
and yet still being repeatedly cited by those who were alleging that Facebook was “contributing 
significantly to vaccine hesitancy.”!”° One Facebook employee lamented that CCDH’s data was 
“now being used to guide major governmental policy decisions” and expressed concern that the 
Biden White House may not be making decisions “based on grounded data.”’'’’ He added, “it 
seems like the WH thinks that if we just removed these 12 accounts, this would cause 65 percent 
of anti-vax misinformation to go away.”!78 


Internal Facebook notes from the July 16 meeting reveal that the Surgeon General’s 
office stated that “the [Biden] Administration is concerned about misinformation generally” and 


'74 Email from Rob Flaherty to Facebook personnel (July 15, 2021, 3:29 PM); see Ex. 51; see also House Judiciary 
Committee’s Transcribed Interview of Nick Clegg (Mar. 1, 2024), at 29 (on file with the Comm.). 

"75 Tnternal email between Facebook personnel (July 16, 2021); see Ex. 55. 

'76 Internal email between Facebook personnel (July 16, 2021, 10:21 AM); see Ex. 57. 

'77 Tnternal email between Facebook personnel (July 16, 2021, 11:58 AM); see Ex. 57. 

178 Ig. 


36 


“made it clear that the [Biden] Administration is indeed concerned that misinformation” on 
Facebook was “jeopardizing proactive COVID vaccination efforts.” '’? The Surgeon General’s 
office also told Facebook that while it had made “some progress” to curtail misinformation, its 
work had “fallen short’ and the company could “do more,” such as by taking “quicker actions on 
harmful content.”'®° In response, Facebook stated that it had “invested considerable resources to 
improve [its] misinformation policies and enforcement actions” and “substantially demoted 
borderline COVID information, even if it is not false.”'*! But that was not enough. Ultimately, 
internal documents reveal that Facebook “left the meeting with the impression that” although the 
Surgeon General’s office wanted Facebook “to do more,” it was not “sure how to encourage [the 
company] to take down more problematic content.’””!* 


On the same day, White House press secretary Jen Psaki again called out Facebook, 
citing CCDH’s claim that 12 people were responsible for most of the problematic content online, 
noting that there were “additional steps” that platforms could take to censor such content, and 
adding that the Biden Administration had been flagging general “trends” or “narratives,” but “not 
specific posts,” for Facebook’s attention.'®* Shortly after Psaki’s statements, President Biden told 
a reporter that social media companies like Facebook were “killing people” by allowing Covid 
misinformation to spread on their platforms. '*4 


Following Biden’s statements, Facebook leadership (CEO Mark Zuckerberg, COO 
Sheryl Sandberg, Nick Clegg, VP of Global Affairs, and Joel Kaplan, VP for Public Policy) 
texted noting that “The behavior of the WH over the last 24 hours has been highly cynical and 
dishonest,” especially given that the Surgeon General’s office had “privately” been telling 
Facebook that it had been doing a “decent job.”!®> 


” Internal email between Facebook personnel (July 16, 2021); see Ex. 55. 

80 Td. 

81 Td. 

82 Td. 

83 Id; Press Briefing by Press Secretary Jen Psaki, July 16, 2021, THE WHITE HOUSE. 

84 See Nandita Bose and Elizabeth Culliford, Biden says Facebook, others ‘killing people’ by carrying COVID 
misinformation, REUTERS (July 16, 2021). 

85 Message thread between Facebook senior leadership (July 16, 2021); see Ex. 56. 
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Zuckerberg asked if they considered including that “the WH put pressure on us to censor 
the lab leak theory” as part of its “generic pressure” for the company to “do more.”!*° 


Mark 
Zuckerberg 


CONFIDENTIAL TREATMENT REQUESTED META-118HJC-0063522 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Sheryl Sandberg texted that the White House was “scapegoating” Facebook to “cover 


their own missed vaccination rates and a virus they can’t get control of through public policy.”!*’ 


Mark 
m™: Zuckerberg 


The text thread also reveals that Facebook leadership believed it was in a “knife fight” 
with the Biden White House that may warrant reaching out to Steve Ricchetti, a counselor to 
President Biden.'*® Zuckerberg thought that the President’s statement was coordinated with Jen 
Psaki’s statement and the Surgeon General.!°? 


The text thread mentioned how the Biden White House was telling reporters that “they 
have long demanded more action from” Facebook, which was “true,” but Facebook had already 
“done so much to promote authoritative information” and had been “more effective than other 
platforms at combating misinformation.”!”? Consequently, Facebook leadership considered 
whether it should “change [its] model” of how it worked “with the WH on this,” noting, “If 


186 Td. 
187 Td. 
188 Td. 
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they’re more interested in criticizing us than actually solving the problems, then I’m not sure 
2191 


how it’s helping the cause to engage with them further. 


Clegg added that “whether the WH want[ed] to deescalate” the situation — “tho[ugh] 
much damage ha[d] already been done,” and Facebook “need[ed] to reset” its “working 
relationship with them.”!°? Facebook leadership also noted the double standard between the 
media coverage of statements by President Biden versus President Trump, stating, “Did Trump 
say things this irresponsible? If Trump blamed a private company not himself and his govt, 
everyone would have gone nuts.”!?? 


On July 16, 2021, Clegg emailed Surgeon General Murthy about “what has transpired 
over the past few days following the publication of the misinformation advisory, and culminating 
today in the President’s remarks about” Facebook.'!** Clegg explained to Murthy that teams from 
Facebook and the Surgeon General’s office met to “better understand the scope of what the 
White House expect[ed] from [Facebook] on misinformation going forward.”!®> Facebook noted 
that while it certainly had understood “for some time” that there was “disagreement on some of 
the policies governing [its] approach and how they are being enforced,” it felt unfairly singled 
out and wanted “the opportunity to speak directly to discuss a path forward.”!** On July 19, 
2021, Surgeon General Murthy replied, stating, “I know the last few days have been challenging. 
I’d be happy to speak directly about how we move forward.”!?” 


July 17-21: Facebook in Damage Control 


On July 17, a Vice President at Facebook, emailed Anita Dunn, a senior advisor to 
President Biden, seeking “to connect with [Dunn] on the President’s comments on Covid misinfo 


1 Td. 
Td. 
3 Td. 
°4 Email from Nick Clegg to Surgeon Gen. Vivek Murthy (July 16, 2021, 5:43 PM); see Ex. 58. 
3 Td. 
© Td. 
°7 Email from Surgeon Gen. Vivek Murthy to Nick Clegg (July 19, 2021, 3:29 PM); see Ex. 58. 
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and [Facebook’s] work there. Really could use your advice and counsel on how we get back to a 
good place here.”!° The Facebook employee added: 


While there’s always been a disagreement on where the lines should be on misinfo 
generally, we have genuinely tried to work with the administration in good faith to 
address the gaps and solve the problems. As I hope you know, we’ve been doing a 
significant amount of work to both fight the misinfo and fight the pandemic through 
authoritative information. Obviously, yesterday things were pretty heated, and I’d 
love to find a way to get back to pushing together on this — we are 100% on the 
same team here in fighting this and I could really use your advice.!” 


In response, on July 17, Dunn added Flaherty to the email chain because, in Dunn’s 
words, “he has been following your platform (and others) closely when it comes to flow of 
information and misinformation.””” Flaherty chimed in, stating that he was “[h]appy to 
connect.””°! And Ginsburg replied back, “We’d love to find a way to get things back to a 
productive conversation,” adding other Facebook personnel to the email chain and noting that 
Rob and the employee “have a tight working relationship already.””°” The employee then chimed 
in, noting that Facebook “had a conversation with the Surgeon General’s office yesterday to 
discuss the advisory In [sic] more detail and hope to continue to work to address concerns.”? 
The Facebook employee concluded his email, noting “Along with David [Ginsburg]—I am 
really hoping to close the gap in terms of what’s playing out publicly and what we might be able 
to accomplish working together,” adding “Rob—I’m around anytime for a conversation.”?™4 


Meanwhile, on July 17, 2021, Facebook circulated an email internally about running an 
exercise to “determine the content that the White House would want us to remove vs what we are 
currently removing,” so that it could demonstrate that it was “in fact removing a sizable 
proportion of content and that the remaining delta is not content that the general public would be 
comfortable with [it] removing.” In its discussion, Facebook pointed out that the Surgeon 
General’s advisory defined misinformation “to include people posting truthfully about 
experiencing rare side effects,” which it “obviously strongly disagree[d] with.”?°° 


On July 17, 2021, Facebook also published a statement entitled, “Moving Past the Finger 
Pointing,” in which it noted that, while the “Biden administration has chosen to blame” 
companies like Facebook for failing to meet its vaccination goals, Facebook had been taking 
action against vaccine misinformation, including “on all eight of the Surgeon General’s 
recommendations.”””” Clegg privately texted this statement to the Slavitt, stating that Facebook 
was hoping to avoid “further public broadsides,” and would reach out to Surgeon General 


198 Email from Facebook personnel to White House staff (July 17, 2021, 5:52 PM); see Ex. 60 (emphasis added). 
199 Td. (emphasis added). 

200 Email from White House staff to Facebook personnel (July 17, 2021, 5:56 PM); see Ex. 60. 

201 Email from Rob Flaherty to Facebook personnel (July 17, 2021, 3:06 PM); see Ex. 60. 

202 Email from Facebook personnel to Rob Flaherty (July 17, 2021, 6:14 PM); see Ex. 60. 

203 Email from Facebook personnel to Rob Flaherty and Facebook personnel (July 17, 2021, 3:23 PM); see Ex. 60. 
204 Td. (emphasis added). 

205 Tnternal email between Facebook personnel (July 17, 2021, 7:57 AM); see Ex. 59. 

206 Tnternal email between Facebook personnel (July 17, 2021, 11:08 AM); see Ex. 59. 

207 Guy Rosen, Moving Past the Finger Pointing, FACEBOOK (July 17, 2021). 
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Murthy in the hopes that it could “resume a sensible conversation, notwithstanding the 
differences,” “reset and move on.” Slavitt replied, noting that the Biden White House did not 
think Facebook’s statement was “very productive,” and that the company was “talking around 
the problem” instead of focusing on “what more could [it] do,” the latter of which, the Biden 
White House stated, “is how [it could] move past finger pointing.””°’ Clegg stated that while 
Facebook understood the White House’s position, it was a “big deal when POTUS accuses a 
major US Corp of killing people.”?!° Slavitt countered that the Biden White House was right to 
be “troubled” that “7 of the top 10 vaccine posts on FB are anti-vaxx,” such as a post by Candace 
Owens that stated “the government is hiding vaccine deaths.”*!! He added that the Biden White 
House wanted Facebook “to come clean with how many people see these posts and what [the 
company was] doing about them,” adding that it has “asked and asked” for this information.”!” In 
response, Clegg told Slavitt that Facebook was “now doing a full refreshed analysis of the delta 
between FB’s misinfo coverage/definition and what [it thought] the WH would want [it] to 
do.’”2!3 


On July 19, as Facebook worked to identify the “delta [] for what the WH would want 
removed (vs what [Facebook did] remove),” senior Facebook employees texted back and forth 
about the pressure the company was under from the Biden White House.?!* Clegg wrote that the 
“WH advisor” he had “been dealing with [was] totally focused on [the] top 10 Crowdtangle 
Covid posts.”?!> He added that, “The Biden walkback of his earlier comments is significant — and 
v deliberate — I think the way he hit back this weekend had a real effect.”*'® Clegg noted that he 
had been communicating with Facebook CEO Mark Zuckerberg “re the significance of the WH 
olive branch.”?!’ Clegg also informed his team that over the last several days he had had phone 
“calls with Andy Slavitt et al till 3 am on several occasions” and “many calls” with Zuckerberg 
and Sandberg, adding that the White House and wanted Facebook to “take down content is 
which by most measures annoying/alarming but not necessarily harm inducing misinfo.”?!* In 
response, Clegg’s team brainstormed ways Facebook could “repair the relationship with the 
WH,” while Clegg noted that repairing the relationship would be difficult because “there simply 
isn’t consensus on what misinfo is” and so Facebook needed to know what its “coverage of 
misinfo” was versus what it thought “the WH would like to see.””!? 


July 21, 2021: Facebook’s internal memo on the gap between what the Biden White 
House wanted removed and what Facebook felt comfortable removing 


208 Text messages between Nick Clegg and Andy Slavitt; see Ex. 53. 
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On July 21, a Facebook employee circulated an internal memo for Nick Clegg, stating, 
“There is likely a significant gap between what the WH would like us to remove and what we are 
comfortable removing. There are some policy mitigations that could get the two parties closer, 
but Content Policy does not recommend pursuing them.”?”° 


Nick, 


TLDR: There is likely a significant gap between what the WH would like us to remove and what we are 
comfortable removing. There are some policy mitigations that could get the two parties closer, but Content 
Policy does not recommend pursuing them 


You asked for information about the delta between content that Facebook is removing and the White House 
wants us to remove and mitigation options. The White House rarely provides any specificity about what it wants 
removed, but it routinely complains to us about content identified in critical media reports. We’ve compiled 
specific criticisms and extrapolated from more general complaints below: 


The memo outlined the “delta” between the content that Facebook was removing and the 
content that the Biden White House wanted Facebook to remove as well as “mitigation 
options.”””! For example, the Biden White House expressed its desire for Facebook to disable 
accounts across its platforms and remove “all links to the Disinfo Dozen’s off-platform 
domains,” both of which Facebook had previously reserved only “for child safety and dangerous 
organization violations.”?”” 


1. Cross-platform disables: 

a. Delta: The WH wants cross-platform disables. VWe only do cross-platform disables for child 
safety and dangerous organization violations. 

b. Mitigation (not recommended): We could remove all of a person’s groups/pages/accounts once 
they have had a single group/page/account removed for covid misinfo violations. This would 
remove approximately 50 non-violating entities associated with the Disinfo Dozen, including many 
entities that have nothing to do with COVID or vaccines. We are continuing to research what other 
entities might be affected. 


2. Off-Platform Links: 

a. Delta: The WH wants all links to the Disinfo Dozen’s off-platform domains removed. We only remove 
links to off-platform content if the content violates child safety or dangerous organizations violations. 

b. Mitigation (not recommended): We could remove all posts from FB/IG if the posts contain a link to 
domains associated with covid misinfo violators, but it would likely remove significant amounts of benign 
content posted by regular users, such as their posts about person experiences or government criticism 
that also include a link to a website. Some of the off-FB/IG websites also have non-covid-related 
content, so we could be removing posts that are not about COVID and link to the websites for 
nor-COVID reasons. It is unlikely that we have capacity to review individual off-platform links, so we 
would likely have to execute at a domain level. 


The memo stated that the Biden Administration wanted Facebook “‘to remove true 
information” about vaccine side effects.?”° 


220 Internal email from Facebook personnel to Nick Clegg (July 21, 2021, 8:35 PM); see Ex. 63. 
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1. True information: 
a. Delta: The Surgeon General wants us to remove true information about side effects if the user does not 
provide complete information about whether the side effect is rare and treatable. We do not recommend 


pursuing this practice. 
b. Mitigation (not recommended): We currently label all of this content and demote some of it. We could 
remove the content or increase the demotion strength. 


Additionally, the memo noted that the Biden White House would like Facebook to 
“remove content that provides any negative information on or opinions about the vaccine without 
concluding that the benefits of the vaccine outweigh that information or opinion” as well as 
“humorous or satirical content that suggests the vaccine isn’t safe.”?74 


1. Other Vaccine Hesitant Content: 

a. Delta: The WH generally objects to content that appears in media criticism of our covid misinfo efforts. 
While we don't have specifics, we can extrapolate that they would like us to remove content that provides 
any negative information on or opinions about the vaccine without concluding that the benefits of the 
vaccine outweigh that information or opinion; humorous or satirical content that suggests the vaccine 
isn't safe 

. Mitigation: Similar to true information, we recommend adhering to expert advice that we allow open 
discussion of vaccine safety and efficacy and do not recommend removing this content. We could 
consider increasing the demotion strength on content being demoted that is still breaking through into top 
posts. 


The memo also indicated that it was likely that the Biden White House wanted Facebook 
to remove “true content and criticism of the government, both of which,” the company felt the 
need to add, “are appropriate to allow on platform.”””° 


Detailed Assessment of Other Vaccine Hesitant Content: 
1. The #2 ranked content is an ABC News report about side effects. It is deemed “negative.” 
a, Delta assessment: We don't know whether the WH would propose that this reporting from 
network news should be removed for accurately reporting on side effects. We do not 
recommend doing so. 


CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0062108 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


1. Five pieces of content (ranking 1, 5, 7, 13, 14) were borderline content and were demoted and labeled, but 
the demotion strength did not remove them from the top 100 FB posts for the relevant time period. All 
received the label: “COVID-19 vaccines go through many tests for safety and effectiveness and are then 
monitored closely” with a link to FB'’s COVID-19 Information Center. 

a. Delta assessment (content assessment below): We suspect the WH believes this content 
should be removed, We demote and label this content because we find it irresponsible in its 
sensationalism and lack of context; however, it is a mix of true content and criticism of the 
government, both of which are appropriate to allow on platform. 

b. #1, 5, and 7 are from Candace Owens and suggest that the vaccine is experimental or has side 
effects, including death, and are critical of the government. #5 was also fact-checked by a 
3PFC. 

. #13 is from Tucker Carlson and offers sensationalized reporting on a true incident of a 12 year 
old suffering a rare side effect and and reporting on a study published in the Journal of the 
American Medical Association (JAMA) Pediatrics about the dangers of wearing masks to 
children. The content was posted the day after the JAMA study was published. JAMA 
retracted the study two weeks after publication. 

. #15 is from Turning Point USA and suggests that the government has no authority to mandate 
taking an experimental vaccine. 
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The internal Facebook memo further explained that the Biden White House had 
“previously indicated that it thinks humor should be removed if it is premised on the vaccine 
having side effects,” so Facebook “expect[ed] it would similarly want to see humor about 
vaccine hesitancy removed.””*° The memo noted that it did not have “insight” into whether the 
Biden White House wanted Facebook to remove “personal opinions about government mandates 
or explanations of personal choices not to get the vaccine,” again feeling the need to add, “We 
believe there is a strong interest in protecting the expression of personal opinion and personal 
choice.””?’ 


, 6, 8, 11, 12) were labeled neg ; 

a. Delta assessment (content assessment below): The VWH has previously indicated that it thinks 
humor should be removed if it is premised on the vaccine having side effects, so we expect it 
would similarly want to see humor about vaccine hesitancy removed. We don't have insight into 
whether the VWWH wants personal opinions about government mandates or explanations of 
personal choices not to get the vaccine removed. Ve believe there is a strong interest in 


protecting the expression of personal opinion and personal choice. 

b. #4 is a cartoon attempt at humor, suggesting that door-to-door vaccinators would be tied to 
trees. 

c. The other four pieces of content all offer personal opinions about mask or vaccine mandates or 
the decision to be vaccinated. 


Finally, the memo outlined the “aggressive actions” that Facebook had taken to censor 
the Disinfo Dozen since March 2021, including by “expanding the amount” of misinformation it 
removed and “by giving the ‘Worst of the Worst’ Entities 48 hours to remove all violating 
misinformation or otherwise [] be removed” from the platform.” The memo boasted that, 
consequently, Facebook removed “known anti-vaxxers” such as Robert F. Kennedy Jr.’s 
Instagram account, chilling the speech of many of these individuals.””? The memo concluded by 
noting that Facebook had removed at least one account associated with 11 of the 12 Disinfo 
Dozen individuals, adding that when it came to the 12" individual, who posted “mainly about 
internet censorship now,” Facebook was “watching his profile closely.””*° 


Disinfo Dozen Status On Platform: 

1. We have been aware of the Disinfo Dozen back in March. We took very aggressive actions based on them, 
and other entities we flagged, by expanding the amount of Misindo that we remove and by giving the “Worst 
of the Worst" entities 48 hours to remove all violating misinformation or otherwise they would be removed. 
As aresult of that, we removed known anti-vaxxers such as RFK Jr.’s IG Account. 

. This resulted in behavior modification by these actors -- RFK stopped posting anti-vax content on his FB 
page, and some other members of the Disinfo Dozen also stopped posting violating content. 
. We have continued to monitor these accounts and have found the following: 


a. 91 entities are tied to the Disinfo Dozen (however, the majority of these entities do not share anti-vax 
content and some post infrequently or stopped posting altogether). 

b. 23 of those entities have been removed. 

c. We are confirming additional entities (approx. 15) that may be removed under our “Single Use Muttiple 
Account” and Recidivism policies (we are aiming to have these results by EOD) 

d. 11 of the 12 Disinfo Dozen members have had one entity removed by us. The 12th posts mainly 
about internet censorship now. We are watching his profile closely. 
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In response to this memo, Facebook COO Sheryl Sandberg asked Clegg if Facebook 
should “do more” to appease the Biden Administration.”*! In his reply, Clegg noted that 
Facebook was also considering “what more data we can share with them which is a big ask from 
the WH,” adding that ““what the WH appears to want us to remove ranges from humor to totally 
non violating chatter about vaccines. I can’t see Mark [Zuckerberg] in a million years being 
comfortable with removing that — and I wouldn’t recommend it.””*? Ultimately, Clegg noted that 
Facebook should “wait to see what Surgeon Gen tells me on Fri before deciding how/whether we 
need to make any bigger moves.’”??? 


On July 22, 2021, Clegg emailed internally to discuss how Facebook would handle its 
meeting with the Surgeon General the following day.”*4 Emails show that Facebook planned to 
ask Surgeon General Murthy about “what specific types of misinfo” it was missing so it could 
“move forward productively.””*> Clegg also included “Andy Slavitt’s overnight advice on how to 
understand where the WH is coming from,” which was that the Biden White House would be 
“frustrated” until Facebook could tell them “how much misinfo [was] being seen by people” and 
made “a pledge to reduce the amount of misinfo,” the latter of which was “all they care[d] 
about.””3° Clegg also mentioned that Facebook COO Sheryl Sandberg was “keen that we 
continue to explore some moves that we can make to show that we are trying to be responsive to 
the WH,” while noting that that the “blackholing idea,” which Facebook had initially considered, 
would not “work after all” given that it would eliminate a lot of benign content.”*” Clegg 
concluded his email by noting that he believed Facebook’s “current course — in effect explaining 
ourselves more fully, but not shifting on where we draw the lines or on the data we provide” was 
“a recipe for protracted and increasing acrimony with the WH.”?** Clegg then added, “Given the 
bigger fish we have to fry with the [Biden] Administration,” that “doesn’t seem a great place for 
us to be, so grateful for any further creative thinking on how we can be responsive to their 


concerns.””*? 


On July 23, 2021, Facebook met with Surgeon General Murthy.”4° During the meeting, 
Clegg explained to the Surgeon General that, “NOT ONE SINGLE post in the top FB 100 posts 
listed in the reports [Facebook had] to submit to the [Biden] Administration over the last several 
weeks [was] in any way associated with the ‘disinfo dozen.’””4! But Murthy pushed back. As 
one Facebook employee who attended the meeting recalled, “One thing from Dr. Murthy 
mentioned at the end [of the meeting] — perhaps worth including as a signal of things to come? — 
is a broader concern from a well being perspective. He talked about how he travels the country 


231 Internal email from Sheryl Sandberg to Nick Clegg (July 21, 2021, 11:01 PM); see Ex. 63. 
232 Internal email from Nick Clegg to Sheryl Sandberg (July 21, 2021, 2:13 PM); see Ex. 63. 
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234 Internal email from Nick Clegg to Facebook personnel (July 22, 2021, 12:20 AM); see Ex. 64. 
235 Iq. 

236 Iq. 

237 Iq. 

238 Iq. 
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240 Emails between HHS staff and Facebook personnel (July 23, 2021, 5:34 AM); see Ex. 50. 

41 Internal email from Nick Clegg to Facebook personnel (July 24, 2021, 9:40 AM); see Ex. 66. 
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and hears concerns from people and questions about whether social media is bad for kids, and 
how this current health misinfo issue is the first one to figure out for the industry.”?” 


Ultimately, following the July 23, 2021 meeting, Clegg emailed the Surgeon General to 
inform him about the steps Facebook had taken “just this past week to adjust policies” to 
“remove” more “misinformation” and further censor the Disinfo Dozen.”*? Clegg added that it 
heard the Surgeon General’s “call for [Facebook] to do more” and would keep him informed on 
the “4 specific recommendations for improvement” he identified.” 


Internally, Facebook continued to struggle with how to respond to respond to the Biden 
White House’s unreasonable demands about the Disinformation Dozen, noting in one July 24, 
2021 email, for example, that it was “in a tough spot as the WH’s case — while wrong — is very 
simple: 12 people are responsible for the vast majority of the anti-vaccine content on Facebook 
and they’re (almost) all still active on the platform.””4° The email noted that “treating some of 
these people” as it treated “Dangerous Orgs and Individuals” may be the “only approach” that 
would bring Facebook “closer in line with the media/WH/policy elites view that [Facebook] 
should be banning people who repeatedly break [its] rules from all [its] apps.””4° 


Meanwhile, the Biden White House’s pressure campaign, grounded on the CCDH’s false 
claims, continued. On July 26, 2021, Facebook internally noted that given the “unrelenting 
staying power of the misleading stat that 12 people are responsible for 65% of COVID/vaccine 
misinformation,” featured twice “in comments last week from President Biden,” it felt the need 
to draft a post about the action it had already taken against the Disinfo Dozen and how their posts 
represented just a fraction of a percent of Facebook’s total vaccine related content, and that, over 
the past two months, not a single post in Facebook’s most-viewed vaccine content was from a 
Disinfo Dozen-associated account.**” 


E. August 2021: Facebook Relents to the White House Pressure and Changes Its 
Content Moderation Policies 


The preceding few weeks proved too much pressure for Facebook’s leadership to handle 
and the order was given from the top: change the company’s content moderation policies as 
quickly as possible. 


On August 2, 2021, a Facebook employee circulated an internal email with the subject 
line “Urgent help assessing misinfo/misinfo adjacent Policy options.””** In the email, the 
Facebook employee noted that, “Leadership asked Misinfo Policy and a couple of teams on 
Product Policy to brainstorm some additional policy levers we can pull to be more aggressive 


242 Internal email from Nick Clegg to Facebook personnel (July 26, 2021, 11:50 AM); see Ex. 67. 

243 Email from Nick Clegg to Surgeon Gen. Vivek Murthy (July 23, 2021, 7:29 PM); see Ex. 69. 
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245 Internal email from Facebook personnel to Nick Clegg (July 24, 2021, 2:44 PM); see Ex. 60. 
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47 Tnternal email from Facebook personnel to Nick Clegg and other Facebook personnel (July 26, 2021, 11:34 AM); 
see Ex, 70. 

248 Tnternal email between Facebook personnel (Aug. 2, 2021, 5:39 PM); see Ex. 29. 
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against Covid and vaccine misinformation. This is stemming from the continued criticism of our 
approach from the US administration.” 


Fc, I & 
Sent: Monday, August 2. 2021 5-39 PM 


@fb.com @fb.com 
@tb.com 
@fb.com 
@fb.com 


fb.com 
@fb.com 


@fb.com 
Subject: Urgent help assessing musinfo/misinfo adjacent Policy options 


Hi PMs in the To line 


With apologies in advance for the short notice, could we please ask for a quick gut check by 1 pm PT tomorrow 
(Tuesday) on the implementation feasibility of this list <https://docs google com/document d/1x-EkjIF- 

l_ eNTXeNx-UwYP8Y15YKUHizur8BrTqyD9c/edit> of policy options to be more aggressive against Covid and 
vaccine nusinformation. to inform a leadership conversation happening Wednesday? 


Context: Leadership asked Misinfo Policy and a couple of teams on Product Policy to brainstonm some additional 
policy levers we can pull to be more aggressive against Covid and vaccine misinformation. This is stemming from 
the continued criticism of our approach from the US administration and a desire to kick the tires further internally on 
creative options. (We know there’s also a parallel effort to brainstorm Product/BTG levers we can pull.) 


Given the intense pressure Facebook was under to move quickly, the employee noted that 
Facebook’s Product team had “not had time to fully vet most of these ideas” and Facebook’s 
Data Science team had not “analyze[d] these options” to “fully understand their ultimate on- 
platform impact.”°° The employee also noted that the “recommendations [were] specifically 
targeted at addressing the problem posed by the disinformation dozen accounts continuing to 
have presences on Facebook/Instagram,” adding that, “Most of the problematic content critics 
such as the Center for Countering Digital Hate (CCDH) associate with the disinfo dozen are 
URLs to off-platform content [Facebook didn’t] enforce on as a matter of principle.””>! As a 
result, the Facebook employee noted that Facebook “could change [its] policy approach and start 
enforcing off platform, but [her team didn’t] support that from a principled perspective,” adding 
that it also “would be resource intensive to implement.” 7°? Given that “blackholing their 
domains is too blunt, since lots of the content they post on- and off-platform is not even about 
Covid or vaccines,” the Facebook employee “recommend[ed] steps to give less distribution to 
disinfo dozen URLs so they have less reach and visibility.”?> 
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Our recommendations are specifically targeted at addressing the problem posed by the 
disinformation dozen accounts continuing to have presences on Facebook/Instagram. 
Most of the problematic content critics such as the Center for Countering Digital Hate 
(CCDH) associate with the disinfo dozen are URLs to off-platform content we don’t 
enforce on as a matter of principle. This URL content appears to have a higher prevalence 


of violating/BV content than the on-platform content posted by the disinfo dozen. We 


could change our policy approach and start enforcing off platform, but we don’t support 
that from a principled perspective and this would be resource intensive to implement. 
And blackholing their domains is too blunt, since lots of the content they post on- and off- 
platform is not 2 about Covid or vaccines. Instead, we’re recommending steps to give 
less distribution fadisinfo dozen URLs so they have less reach and visibility. For example, 
our fact-checkers have rated some of the most viral and misleading disinfo dozen URLs, so 


one option below is to leverage that signal to give even less distribution to these domains. 


atorcement 


Impact: If we blackholed all 28 URL domains associated with the Disinfo 
Dozen, this would remove at least 250M pieces of content, including 
private messages. Furthermore, if we blackholed all URL domains 
associated with any entity we remove for health misinfo violations, the 
amount of content removed would be astronomical. 

Recommendation: We do not recommend, as it risks enforcing on large 
volumes of historical content that may not be violating or unrelated to 
COVID/vaccines. 


' Blackhole (to) = block across all FB surfaces, ie. content will not be displayed (and, by extension, will be 
impossible to click on) 


The next day, Facebook discussed internally its “touchy relationship with [the Biden 


White House], which specifically want[ed] [it] to demonstrate additional steps on four issues 
they’ve raised, including doing more to address the disinfo dozen actors.” As a result, 
Facebook admitted that its “solutions” were “mostly tailored around addressing [the Disinfo 
Dozen].””°° On August 5, 2021, Clegg’s team provided him with an update on Facebook’s 
response “to the four asks from the White House” that were “named in the Surgeon General’s 
Advisory,” outlining four actions Facebook could take to further censor COVID and vaccine 
related content.?*° 


254 Tnternal message between Facebook personnel (Aug. 3, 2021, 9:46 AM); see Ex. 71. 


256 Internal email from Facebook personnel to Nick Clegg (Aug. 5, 2021, 9:54 PM); see Ex. 72. 
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Subject: Pre-read Re: MTG: Covid/WH update 


Ahead of our meeting tomorrow, we're providing you with an update on our response to the four asks from the 
White House and decisions from you on these options. Please see a link to the pre-read with the full details of 
options here. 


As a reminder, the four asks named in the Surgeon General’s Advisory 


1. Measure and publicly share the impact of misinformation on their platform. Facebook should provide, 
publicly and transparently, data on the reach of COVID-19 — COVID vaccine misinformation. Not just 
engagement, but the reach of the misinformation and the audience that it’s reaching. 

2. Create a robust enforcement strategy that bridges their properties and provides transparency about the rules 

3. Take faster action against harmful posts 

4. Promote quality information sources in their feed algorithm. Facebook has repeatedly shown that they have 
the levers to promote quality information. We've seen them effectively do this in their algorithm over 
low-quality information and they've chosen not to use it in this case. And that’s certainly an area that would 
have an impact 


On August 6, 2021, Facebook met with Surgeon General Murthy.”*’ Following the 
meeting, the Surgeon General’s office followed up with Facebook, asking if the company could 
send “an update of any new/additional steps” that it would be “taking with respect to health 
misinformation in light of the advisory” “within two weeks.”?°* Facebook replied, stating that it 
would provide a response within two weeks “outlining [its] approach.””*? 


Internal Facebook documents indicate that following its meeting with the Surgeon 
General, Facebook met internally and agreed to “further explore four discreet policy options. 
For example, the following day, August 10, Facebook emailed internally, noting the Surgeon 
General office’s request for an update within two weeks, and stating that it would “scope product 
work” for four changes to further censor vaccine related content and “execute ones that are easy 
to do.”6! 
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Over the next two weeks, Facebook internally “scoped the requirements for executing 
those options.””°? On August 19, Facebook leadership circulated an internal memo about how the 
company would respond “to the Surgeon General on COVID-19 misinformation,” which 
included rolling out the four new measures Facebook had prepared following “the continued 
criticism of [its] approach from the [Biden] administration” to more aggressively censor vaccine 
hesitancy and alleged misinformation.”?~ 


Notably, the day before, on August 18, Facebook shared with the Biden White House and 
Surgeon General’s office a statement it had issued regarding how Facebook was handling the 


°57 Internal email from Facebook staff to Nick Clegg (Aug. 19, 2021, 4:24 PM); see Ex. 29. 

258 Email from HHS staff to Facebook personnel and Nick Clegg (Aug. 6, 2021, 4:07 PM) see Ex. 69. 

259 Email from Facebook personnel to HHS staff (Aug. 6, 2021, 9:02 PM); see Ex. 69. 

260 Internal email from Facebook staff to Nick Clegg (Aug. 19, 2021, 4:24 PM); see Ex. 39. 

261 Internal email from Facebook personnel to Nick Clegg (Aug. 10, 2021, 10:08 PM); see Ex. 72. 

262 Internal email from Facebook staff to Nick Clegg (Aug. 19, 2021, 7:24 PM); see Ex. 77; see also Internal email 
from Facebook staff to Nick Clegg (Aug. 13, 2021, 6:21 PM); see Ex. 73. 
63 Internal email from Facebook staff to Nick Clegg (Aug. 19, 2021, 4:24 PM); see Ex. 77. 
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Disinfo Dozen as outlined in CCDH’s report.”™ In the statement, Facebook declared that “there 
isn’t any evidence” to support CCDH’s claim that “12 people are responsible for 73% of online 
vaccine misinformation on Facebook,” noting that “these 12 people are responsible for about just 
0.05% of all views of vaccine-related content on Facebook.””° Facebook then added that 
CCDH’s report, contrary to its claims, did not analyze, or provide evidence that it analyzed, 
representative samples of Facebook posts about COVID-19 vaccines nor did CCDH provide an 
explanation for how it defined or identified content it considered to be “anti-vax” or how it chose 
the 30 groups included in its analysis. 


Nevertheless, on August 20, Facebook emailed Surgeon General Murthy to him update 
him on the new policy changes it was making and “stronger action” it was taking to censor 
vaccine related content, including the Disinfo Dozen, following pressure from the Biden 


Administration.*°’ The next day, Facebook internally noted that “everyone is neck deep right 
99268 


now in WH [White House] response. 


On August 23, Facebook began putting together “the actions that [it] took against the DD 
[Disinfo Dozen]” to add to its email report back to Surgeon General Murthy, although one 
Facebook employee noted that “nothing we say will be persuasive to that crew.”*°? The same 
day, the Surgeon General’s office sent a follow-up email, thanking Facebook for capitulating to 
its demands and noting that it looked forward to “continuing to move forward together with 
urgency and solutions.”””° And with that, the Biden Administration’s censorship campaign had 
completed its mission: one of the world’s largest social media platforms again succumbed to 
pressure and violated its own principles to appease a powerful government office. 


264 Email from Facebook personnel to White house and HHS staff (August 18, 2021, 2:16 PM); see Ex. 74. ; see also 
Monika Bickert, How We’re Taking Action Against Vaccine Misinformation Superspreaders, FACEBOOK (Aug. 18, 
2021), https://about.fb.com/news/202 1/08/taking-action-against-vaccine-misinformation-superspreaders/. 

65 Monika Bickert, How We're Taking Action Against Vaccine Misinformation Superspreaders, FACEBOOK (Aug. 
18, 2021). 
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267 Email from Nick Clegg to Surgeon Gen. Vivek Murthy (Aug. 20, 2021, 3:08 PM); see Ex. 78. 

268 Internal messages between Facebook personnel (July 21, 2021, 9:28 AM); see Ex. 79. 

269 Internal messages between Facebook personnel (July 23, 2021, 12:28 PM); see Ex. 65. 

270 Email from HHS staff to Nick Clegg and Surgeon Gen. Vivek Murthy (Aug. 23, 2021, 7:43 AM); see Ex. 78. 
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Waldo, Eric (HHS/OASH) IEE @hhs.cov> 
Nick Clegg; Murthy, Vivek (HHS/OASH) 

BS Qomail.com: 

8/23/2021 7:43:44 AM 

RE: Facebook Covid actions 


Hi Nick, 


| hope this finds you well. Thank you so much for following up with this detailed note. We are grateful for you and 
your team's attention to the concerns we have been raising and the work to address those ongoing concems. 


Brian and | are also in touch, but we look forward to continuing to move forward together with urgency and 
solutions during these extraordinary times. 


F. 2022: Facebook Continues to Censor Vaccine Hesitancy and the Lab-Leak Theory, 
and Provide Updates to the Biden White House 


The Biden White House continued to pressure Facebook for more information on what 
the company was doing to censor vaccine-related content in September and October 2021, but 
the necessity for the White House’s pressure campaign lessened now that Facebook had new 
content moderation policies in place.”’' Facebook continued to send COVID Insights reports 
through at least July 2022 and continued to inform the Biden White House as it made additional 
changes to its COVID-related policies through at least June 2022.7” Although it no longer 
removed posts related to the lab-leak theory, Facebook also continued to demote the man-made 
theory as well as “vaccine [discouraging] humor posts” until at least January 2022.7 


271 October 2021 email exchanges between Facebook personnel and White House staff (Oct. 28-31, 2021); Ex. 85; 
September 2021 email exchanges between Facebook personnel and White House staff (Sept. 7-18, 2021); see Ex. 
82. 

272 See, e.g., Email from Facebook personnel to White House staff (July 17, 2022, 8:16 PM); see Ex. 93; Email from 
Facebook personnel to White House staff (June 22, 2022, 7:56 AM); see Ex. 88. 

273 Email from Facebook personnel to White House staff (Jan. 24, 2022, 1:28 PM); see Ex. 114. 
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II. THE YOUTUBE FILES 


“Hi Rob — Our YouTube Trust and Safety team is working to finalize a new 
policy to remove content that could mislead people on the safety and efficacy of 
vaccines. We would like to preview our policy proposal for you and get any 
feedback you may have.”?”4 


- Email between YouTube & Google personnel to Rob Flaherty, Biden White 
House’s Digital Director (Sept. 21, 2021, 1:52 PM) (on file with the Comm.) 
asking for the White House’s feedback on a new policy proposal that would 
expand the type of content removed by YouTube. 


The Biden Administration’s interactions with Big Tech regarding content moderation 
were not just limited to Facebook. The White House’s efforts to remove so-called 
“misinformation” extended also to the videos and content Americans had access to on 
YouTube.””> The White House repeatedly expressed particular concern about YouTube’s failures 
to not censor “borderline content’”—1.e., content that does not violate YouTube’s content 
moderation policies.?”° Like Facebook, YouTube ultimately capitulated and changed its content 
moderation policies after months of pressure from the White House. In September 2021, after 
continued criticism for not censoring “borderline” or non-violative content, YouTube shared a 
new “policy proposal” to censor more content criticizing the safety and efficacy of vaccines with 
the White House and asked for “any feedback” they could provide before the policy had been 
finalized.*”’ The White House praised YouTube for expanding the scope of its censorship, saying 
that the update “at first blush, seems like a great step.” 


A. April-May 2021: White House Increases Its Pressure Campaign on YouTube to 
Censor Non-Violative Content 


In the early months of the Biden presidency, the White House was in contact with 
YouTube several times on topics ranging from maximizing their content’s reach on the platforms 
to collaborations with content creators.’”* But these communications turned from promoting 
White House content, to content moderation on April 12, 2021, when Rob Flaherty emailed 
Google, the parent company of YouTube, questioning how the company could better “crack 


274 Email from YouTube & Google personnel to Rob Flaherty (Sept. 21, 2021, 1:52 PM); see Ex. 114. 

275 See Chase Williams, White House worked with YouTube to censor COVID-19 & vaccine ‘misinformation’: House 
Judiciary Committee, FOX BUSINESS (Nov. 30, 2023); Jim Jordan (@Jim_Jordan), X (Nov. 30, 2023, 8:44 PM), 
https://twitter.com/Jim_Jordan/status/173022 1179632226337; Jim Jordan (@Jim_Jordan), X (Dec. 1, 2023, 2:26 
PM), https://twitter.com/Jim_Jordan/status/1730669728002 142706. 

276 See Reduce: How does YouTube reduce the spread of harmful misinformation, YOUTUBE CONTENT POLICIES & 
COMMUNITY GUIDELINES, https://www.youtube.com/howyoutubeworks/our-commitments/managing-harmful- 
content/#reduce. 

277 Email from YouTube & Google personnel to Rob Flaherty (Sept. 21, 2021, 1:52 PM); see Ex. 114. 

278 See Draft Event Memo from Biden Transition Team to YouTube personnel (Dec. 10, 2020); Ex. 95; Email 
exchange between YouTube personnel and White House staff (Jan. 28 — 29, 2021); Ex. 96; Zoom invitation for 
meeting between YouTube and the White House (Feb. 4, 2021, 3:00 PM); Ex. 97; Email exchange between 
YouTube personnel and White House staff (Feb. 24 — Mar. 9, 2021); Ex. 98; Email exchange between YouTube 
personnel and White House staff (Mar. 11 — 12, 2021); Ex. 99. 
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down on vaccine misinformation” on YouTube, and to discuss “ways the White House (and our 
COVID experts) can partner in your product work.”?”° 


On Mon, Apr 12, 2021 at 3:01 PM Flaherty, Rob EOP/WHO <{@ who.cop.gov> wrote: 


Heya -- A while ago, | met with folks from Google about misinformation and COVID-19. Was hoping 
connect again with folks from your side about the work you’re doing to combat vaccine hesitancy, Dugealsy 
crack down on vaccine misinformation. 


* Trends that you’re secing generally around vaccine misinformation on Youtube 


I think we’re primarily interested in: NS 


* The empirical effects your efforts to combat it have had, specifically: “what's g 
* What interventions you might currently be trying 
* | Ways the White House (and our COYID experts) can partner in your ohh. 


‘ , ? 
Would be good to get this on the books later this week and then try to mS y. Hoor can wrangle 


calendars on our side. 


Rob Flaherty O 
Director of Digital Strategy 


The White House 


|: % 


Internal Google emails show that, privately, YouTube understood the true intention 
behind this specific request: “Rob’s questions were very YT focused” and “dug in on our 
decision making for borderline content.”**° Borderline content, according to YouTube, is content 
“that brushes up against our policies, but doesn’t quite cross the line.”*! 


279 Email from Rob Flaherty to YouTube & Google personnel (Apr. 12, 2021, 3:01 PM); see Ex. 100. 

280 Internal email between YouTube & Google personnel (Apr. 13, 2021, 6:08 AM); see Ex. 101. 

281 Reduce: How does YouTube reduce the spread of harmful misinformation, YOUTUBE CONTENT POLICIES & 
COMMUNITY GUIDELINES, https://www.youtube.com/howyoutubeworks/our-commitments/managing-harmful- 
content/#reduce. 
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From: 
Sent: 
To: 


a google.com bd 
4/13/2021 1:08:41 PM ~ 
GE © 20°¢le com); TE BE © 0 0¢!e.com|; fo; 


google.com] 
cc: @google.com] 
Subject: Re: Vaccine Misinfo Nw 


Good Moming, my recommendation would be to schedule an infernal syne to update ougtjet Wo# id 19 

Misinformation Deck with the latest information on our efforts with a deeper dive on Fouj as Rob's 
questions were very YT focused. In our last meeting, Rob particularly dug in on our Re making for 
borderline content. We can also provide an update on the on-going YT creators “Cy cSllaborations. 


nd data? 


We can also share Google Search trends for covid!9 vaccines. Does YT aS 
Could we ask Rob to schedule the meeting for next week to give us my" 


| | awareness and help preparin , Far WH meeting on covid vaccine 


misinformation. 


Google Government A ffairs and Public Policy < 


Washington, DC 20001 
goorle.com 


Android Mobile: 


& « 


The meeting between YouTube’s Government Affairs & Public Policy team and the 
White House occurred on April 21, 2021.*? Later that day, after the meeting, Flaherty sent a 
lengthy follow-up email to YouTube, thanking them for the meeting before making several 
requests for information about various data points of interest to the Administration. Flaherty’s 
email was particularly focused on how YouTube handled non-violative “borderline” content.” 
These requests were prefaced by stating the Biden White House wanted “‘to be sure that you have 
a handle on vaccine hesitancy generally and are working toward making the problem better” and 
that this “is a concern that is shared at the highest (and I mean highest) levels of the [White 


House].”7°4 


282 Zoom invitation for Apr. 21, 2021, meeting between White House and Google & YouTube personnel (Apr. 16, 


2021, 5:10 PM); see Ex. 102. 
283 Email from Rob Flaherty to YouTube & Google personnel (Apr. 21, 2021, 8:05 PM); see Ex. 105. 
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Flaherty, Rob FOP/WHO 
4/22/20211205:16 AM 
google.com); 
googie com; goog e.com; = 


cc: Slavitt, Andrew M. EOP/WHO who.eop.gov]; Humphrey, Ciarke EOP/WHO 
EE 0.20020); Fitzpatrick, Kelsey V. EOP/WHO as .-- eop.gov] 


Subject: Following Up on Today's Corversation 


All-Thanks again for the conversation today. 


We'll look out forthe top trends that you've seen in terms of misinformation around the vaccine. 


To recap: As we move away froma supply problem towarda demand problem, we remain concerned that Youtubeis 
“funneling” people into hesitance and intensifying people’s hesitancy. We certainly recognizethat removing content 
that is unfavoradle to the cause of increasing vaccine adoption is nota realistic or even good — solution. Butwe want 
to be sure that you have a handle on vaccine hesitancy generally and are working toward making the problem better 
This is a concern that is shared at the highest(and | mean highest) evels of the WH, so we’dliketocontinue agood-faith 
dialogue about whatis going on under the hood here. I'm the on the hook for reporting out. 


The YouTube Public Policy team responded to the email with several data points and 
links to resources responding to Flaherty’s many questions, offering to schedule a “follow up 


briefing” for Flaherty on issues of interest to the White House, such as borderline content.7*° 


Immediately following the meeting with the White House on April 21, a Google 
Government Affairs team members asked for more information about vaccine hesitancy on 
YouTube to be shared with the Biden White House. The internal company discussion that 
followed explained plainly what Flaherty wanted: “Really he’s interested in what we’re seeing 
that is NOT coming down.”?*° 


285 Email from YouTube & Google personnel to Rob Flaherty (Apr. 22, 2021, 3:48 PM); see Ex. 105. 
286 Internal email between YouTube & Google personnel (Apr. 21, 2021, 2:31 PM); see Ex. 103. 
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On Wed, Apr 21, 2021 at 2:31 PM [i (EE coogle com> wrote: ~ 
We already have that, thank you. Really he's interested in what we're secing that is (4¥ down, as 
well as whether removals have been more heavily concentrated in any particular < policies. Is it 
fair to say that we're not secing content trends concentrated in any specific area o olicies, but that we 
continue to action content that violates our policy writ large? 

s 6 ) 


On Wed, Apr 21, 2021 at 11:25 AM (ay ae wrote: 


Hi. 
| don't have any qualitative info on trends, but we could pull ey videos we've removed for 
COVID vaccine misinfo, if that would help? 


On Wed, Apr 21, 2021 at 8:04 AM a google.com> wrote: 
i a oc 
GB and | just got off ofa call with the Whitgftioys@who are extremely interested in what we may be 
observing re: vaccine hesitancy on YT. I do no w if we have any of this type of information, but... do 


you have any qualitative info re: things welye obscfwed, trends in content and related messages, ete that 
we could offer to Rob? x 


Thanks! <O 


—— 


The day after the meeting with the White House, the YouTube Public Policy team 
emailed the YouTube Product team warning them that the Biden “White House is very interested 
in our work on borderline content,” and that the Product team had to brief the White House “‘to 
prevent anything from potentially spiraling out of control.”?°’ 


87 Internal email between YouTube & Google personnel (Apr. 22, 2021, 10:38 PM); Ex. 107; see also Internal 
email between YouTube & Google personnel (May 24, 2021, 1:39 AM); Ex. 111 (Flaherty “has been tough on us at 


times.”’). 
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On Thu, Apr 22, 2021 at 2:00 PM =e FE 2002. com> wrote, 
Sure I'd be happy to do that. Would be good to review the logistics again a defstnd how my briefing will 
be used to appropriately calibrate what I say, like we discussed last time wine othetical congressional 
staffer review. O 


On Thu, Apr 22, 2021, 10:38 AM AI 2 2002 some NP 
Hi a 


As you saw from the email thread from [J yesterday, there is a vOky high degree of interest coming from the 
White House now regarding vaccine misinfo/vaccine hesitaggy and our work around borderline content. 
Unfortunately, the role of tech in addressing vaccine hesi about to come under a massive spotlight 
particularly as the supply of the vaccine is soon set tgou emand. It also looks like the White House is 


very interested in our work on borderline content, gid yaor®Spcecifically vaccine related content as well as our 
work to promote authoritative sources for vaccines. 


To begin to address these concerns, and ensure y issues with YouTube are promptly addressed, we 
wanted to see if you would be willing to pro overview briefing to the lead White House digital staffer 
on our work to reduce borderline conten(™\s s ming goes, we were hoping to get something on the 
books in the next two weeks or so to ything from potentially spiraling out of control. 


I'm happy to jump on a call today or tomorrow to discuss further. Appreciate any help you can provide on 


this. r 


On April 29, 2021, about one week after YouTube’s meeting with the White House, the 
YouTube Public Policy team emailed Flaherty to see if they could establish a time for the White 
House to meet with YouTube’s “Director of Global Healthcare Partnerships” and the “program 
manager responsible for leading our efforts to reduce borderline content” who were working to 
“raise authoritative content related to COVID-19 vaccines as well as combat harmful 
misinformation.”** The YouTube Public Policy team emphasized that these individuals would 
be “happy to dive as deep as needed to ensure you get any questions you may have answered.”?*? 


On Thu, Apr 29, 2021 at 7:25 PM google.com> wrote: 
Rob - 


As a follow up to this and our previoys conversation, | wanted to see if you had any availability to meet next 
Thursday or Friday with , the YouTube Director of Global Healthcare Partnerships, as well as 
, who is the You program manager responsible for leading our efforts to reduce borderline 

content. Both fess work each day to raise authoritative content related to COVID-19 vaccines as 

tharm mation, and are happy to dive as deep as needed to ensure you get any questions 

Shoe dates don't work, of course we are happy to accommodate your schedule to find 


well as comba 


you may have ar 
a time that would. 


288 Email from YouTube personnel to Rob Flaherty (Apr. 29, 2021, 7:25 PM); Ex. 108. 
289 Iq 
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Two hours later, the YouTube Public Policy team emailed the YouTube Product team to 
update them on the situation. The Google and YouTube Government Affairs teams were having 
“conversations with the White House staff on YouTube’s policies.””°° Google wanted the 
YouTube Product Team to meet directly with the White House staff, who were “familiar with 
many of [YouTube’s] policies and efforts” regarding removing content, because the White 
House continued to have questions about YouTube’s “raise/reduce efforts.””°! The YouTube 
Public Policy team highlighted the urgency and gravity of the situation by noting the “significant 
attention coming from the [White House] staff on this issue.””°? More critically, YouTube 
needed a positive outcome because the company was seeking “to work closely with [the Biden] 
administration on multiple policy fronts” and therefore needed to appease the White House’s 
censorship demands.”” 


On Thu, Apr 29, 2021 at 3:12 PM <2 20081e.com> wrote: 


Yes let's go for it. 


On Thu, Apr 29, 2021 at 4:38 PM [EH coo gle. com> wrote: : 
a 

Over the last several weeks, the Google & YT GAPP team have had conversations wit @).. 
House staff on YouTube's policies and all the great work that is being done to raise ritative 
information and fight harmful misinformation related to COVID-19 misinfo 


The discussions have been good, and the information has been well received, staff continue to have 
questions on the raise/reduce efforts. Given these questions, particularly among ti® backdrop of 
increasing levels of vaccine hesitancy in the US, we wanted to see if it wey possible for you both 
to participate in a meeting with the staff to provide an overview of i ork. Again, the staff are 
familiar with many of our policies and efforts, but we believe having eS Darcitonity for you both to 
share more background would be hugely beneficial as we seek ne) sely with this administration 


on multiple policy fronts. 

The mecting would be with the White House digital dire Doe, who has been leading a lot 
of the White House work with social media companies ress issues related to COVID-19. If you 
both would be available, we would like to request the mee for next week given the significant 
attention coming from the staff on this issue. < 


I'm happy to answer any questions or provide ; ny Gedpround as needed, and again appreciate your 
consideration of this request. & 


Best Regards, 


~ 


290 Internal email between YouTube personnel (Apr. 29, 2021, 4:38 PM); Ex. 109. 
291 Iq. 
292 Iq. 
293 Iq. 
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On May 4, 2021, the YouTube Public Policy team followed up with Flaherty about 
scheduling the meeting, and Flaherty responded saying he “[w]ould love to chat this week.”?"4 
After some back and forth on scheduling, the meeting was eventually set for May 10.7°° 


During the early months of the Administration, the Biden White House appeared to view 
YouTube as more willing to remove content than Facebook. Indeed, YouTube’s apparent 
willingness to censor Americans was used by the Biden White House to criticize Facebook for 
resisting the pressure to censor more content. For example, in April 2021 Slavitt told senior 
Facebook officials that Facebook “lagged behind” in their content removal efforts compared to 
YouTube, and that YouTube would “never have accepted something like this” when Facebook 
refused to remove a vaccination-related meme.*”° 


B. July 2021: White House Continues Pressure and Flags Examples that Do Not 
Violate YouTube’s Policies at the Time 


The pace of communications between Google/YouTube and the Biden White House 
slowed before picking up again later in the summer of 2021. On July 19, 2021, a few months 
following the meeting between the YouTube Product team and White House officials regarding 
“borderline content,” the YouTube Public Policy team once again contacted Flaherty to highlight 
updates YouTube had made, making “‘it easier for people to find authoritative information on 
health topics.”””’ Flaherty responded the next day saying he was “interested to see it in 
action,””?* but also flagged a tweet from a CNN journalist claiming that after he watched “a few 
videos on the Arizona election ‘audit’” his YouTube algorithm was “feeding” him “anti-vaccine 
content.” The flagged videos included questioning from Senator Rand Paul (R-KY) at a 
congressional hearing and a debate between Robert F. Kennedy, Jr. and Alan Dershowitz.> 


294 Email from Rob Flaherty to YouTube & Google personnel (May 4, 2021, 1:38 PM); Ex. 108. 

295 Email from White House staff to YouTube & Google personnel (May 5, 2021, 3:28 PM); Ex. 108.; Zoom 
invitation for May 10, 2021, meeting between White House and Google & YouTube personnel (May 5, 2021); Ex. 
110. 

256 Internal emails between Facebook personnel (Apr. 18, 2021, 9:34 PM); see Ex. 29. __ 

297 Email from YouTube personnel to Rob Flaherty (July 19, 2021, 1:27 PM); Ex. 112. 

298 Email from Rob Flaherty to YouTube & Google personnel (July 20, 2021, 10:57 AM); Ex. 112. 

29 Td.; Daniel Dale (@ddale8), X (July 19, 2021, 10:32 PM), 
https://twitter.com/ddale8/status/1417130268859772929. 

300 Iq. 
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Daniel Dale © 
@ddales 


| watched a few YouTube videos on the Arizona election "audit" and now 
the algorithm is suddenly feeding me anti-vaccine content next to my 
usual Breaking Bad clips. 


——s 

KENNEDY vs 

DERSHOWITZ 
rue Dabere 


vk Schrader Receives the Gale Heated Vaccine Debate - Kenne ike protem o very dangerous, it's Breaking Bad - Shooting Tuco Si 
aticher Murder File | Open Hous. vs Dershowitz totonic (Robert Malone Steve (S2E2)} | Rotten Tornatoes TV 


king Bad & Setter Call Saul @ 


. —__ -o a 
| 
~)- : | 


Dittermet Di Fave) spetted.Corruptien TOP 10 Heisenberg Moments 
rating Dad Season 3 Episode 6 ® Rand Paul CLASHES with WIN in mustic Sehoche Breaking Bat 
tot in the RV (HD CLIP) over COVID:. 19 vaccines 

‘ ° 


°o 


i — 


10:32 AM - Jul 19, 2021 


1,079 Reposts 156 Quotes 5,543Likes 55 Bookmarks 


Flaherty said “we had a pretty extensive back and forth about the degree to which you all 
are recommending anti-vaccination content. You were pretty emphatic that you are not. This 
seems to indicate that you are. What is going on here?”*°! The YouTube Public Policy team 
responded, saying that “it is important to keep in mind that borderline content accounts for a 
fraction of 1% of what is watched on YouTube in the United States” and that YouTube uses 
“machine learning to reduce the recommendations of this type of content” with the goal of 
keeping “recommended borderline content below 0.5%.’>” 


301 Email from Rob Flaherty to YouTube & Google personnel (July 20, 2021, 10:57 AM); see Ex. 112. 
302 Email from YouTube personnel to Rob Flaherty (July 20, 2021, 2:36 PM); see Ex. 112. 


60 


From: PE @ go0gle.com> 

Sent: Tuesday, July 20, 2021 2:36 PM 

To: Flaherty, Rob R. EOP/WHO <I who.cop. zov> 
Cc: EEE (GEE 2.00 ¢e.com> 


"4 
Subject: Re: [EXTERNAL] YouTube Announcement ge 


Thanks Rob, 


We appreciate your interest in our announcement yesterday. With regards to your question on the Tweet, it is 
important to keep in mind that borderline content accounts for a fraction of 1% qf whgt is watched on 
YouTube in the United States. We use machine learning to reducc the ree ns of this type of 
content, including potentially harmful misinformation. In January 2019, we a ced changes to our 
recommendations systems to limit the spread of this type of content whtig Ge t€d in a 70% drop in 
watchtime on non-subscribed recommended content in the U.S. and ouggO%iS to have views of non- 
subscribed, recommended borderline content below 0.5%, I will knotted with any new policy or 
product improvements that we make as we continue our work tg pewple find authoritative health 
information on YouTube. 


Best Regards 


On Tue, Jul 20, 2021 at 10:57 AM Flaherty, R. OP/WHO <Q © who.cop.gov> wrote: 
GE — Thanks for this. Interested to seg it on. 


I’m curious: Saw this tweet. >>https? com/ddalc8/status/1417130268859772929<<; 


I think we had a pretty extensive back and forth about the degree to which you all are recommending anti- 
vaccination content. You wegg pretfY emphatic that you are not. This seems to indicate that you are. What is 
going on here? rw 


Thanks! WO 


-Rob 
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Flaherty challenged this assertion, saying “I see that’s your goal — what is the actual 
number right now?” Inquiring further, Flaherty questioned whether the content mentioned in 
the tweet counted as “violative content that has slipped through” or if the posts were “in- 
bounds.”°"4 The YouTube Public Policy team responded by stating that the videos Flaherty 
referenced were “not in violation of our community guidelines.”3° 


On Jul 20, 2021, at 8:27 PM @eepzie.com> wrote: 


Rob - 


I'll check with our team and share any @gehite data points we have available. Per our COVID-19 medical 
misinformation policy, we will remove afMcontent that contradicts local health authorities’ or the World 
Health Organization’s (WHO) medical information about COVID-19. To date, approximately 89% of videos 
removed for violations of this policy were removed with 100 views or less. With regards to the specific videos 
you referenced, the content was%ot in violation of our community guidelines. 


Best Regards, 


. Ry 
~s 
= ~S 


2 C r 
On Tue, SON 21 at 3:58 PM Flaherty, Rob R. EOP/WHO <]R@ who.cop.gov> wrote: 
°S 


ir goal — what is the actual number right now? 


I Ke: 
sg; Gocs the content that Daniel Dale references in his tweet count as violative content that has slipped 
hkguel 


I 
em! R? Or is it that generally the stuff he’s posting is in-bounds? 


A month later, on August 23, 2021, Flaherty reached out to YouTube’s Public Policy 
team to discuss vaccine information.*”° He flagged the FDA’s approval of the Pfizer vaccine, and 
asked how YouTube was planning to promote it.*°’ Flaherty added that the White House would 
“appreciate a push here” and provided “suggested language” about how to amplify the Biden 
Administration’s message.*°* A member of the Google Public Policy team responded, saying that 
“a number of product teams across Google/YouTube” were planning updates based on FDA’s 
announcement and that she would “follow up in the coming days with more details.”°°’ She 
further meluded that she had shared the suggested language from Flaherty “across the internal 
teams.” 


303 Email from Rob Flaherty to YouTube & Google personnel (July 20, 2021, 3:58 PM); see Ex. 112. 
304 Iq. 

305 Email from YouTube personnel to Rob Flaherty (July 20, 2021, 2:36 PM); see Ex. 112. 

306 Email from Rob Flaherty to YouTube & Google personnel (Aug. 23, 2021, 9:50 AM); see Ex. 113. 
307 Iq. 

308 Iq. 

309 Email from Google & YouTube personnel to Rob Flaherty (Aug. 23, 2021, 11:29 PM); see Ex. 113. 
310 Tq. 
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@google.com] 
{23/2021 11:29:19 PM 


Flaherty, Rob R. EOP/WHO [IO who.eop.gov] 
(260016 or I IE ©200¢'0. cor] 


Re: Pfizer Approval 


to raise up authoritative information on COVID19 vaccines both across our products an 
PSA efforts. I've also shared your language across the internal teams. Thanks again! 


zh our marketing 


Google US Federal Government Affairs and Public Policy 


Washington, DC 20001 
(google.com 


Android Mobile yy 


On Mon, Aug 23, 2021 at 9:50 AM Flaherty, Rob R. EOP/WH 


Team Google -- < 


Now that FDA has approved Pfizer, I’m making the r nt) get a sense from the various platforms how (or 
if) folks are planning to promote it in any way. & 


We'd appreciate a push here, given the fact that (Fifi an oft-cited blocker for many folks. 


Suggested language from us: O 


the COVID-19 vaccine has received fit Ova tar the PDA and protects against the more dangerous 
delta variant. If you have been waiting for this approval before getting the vaccine, now is the time to get 
' vaccinated. 


Thanks! 


nN 
0 
o 
Oo 


Director of Digé tegy 
The White H 


: -Rob 


Rob Flaherty 


On August 25, 2021, just two days later, YouTube’s Chief Product Officer, Neal Mohan, 
posted a blog discussing the company’s approach to misinformation.*!! Mohan included in this 
blog that “today, we remove nearly 10 million videos a quarter,” and that “since February of 
2020 we’ve removed over 1M videos related to dangerous coronavirus information.”*!* Mohan 
also stated that “[s]peedy removals will always be important but we know they’ re not nearly 


311 Neal Mohan, Perspective: Tackling Misinformation on YouTube, YOUTUBE OFFICIAL BLOG (Aug. 25, 2021). 
sy 
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enough,” and that “the single most important thing we can do” is “increase the good and 
decrease the bad.””?!3 Not mentioned in the blog post was the Biden White House’s continued 
pressure campaign happening behind the scenes. The following month, YouTube enacted new 
policies that mirrored the Biden White House’s understanding of what constituted “good” and 
“bad” information. 


C. September 2021: YouTube Changes Its Content Moderation Policies, Seeking 
Feedback from the Biden White House on Proposed Changes 


Following months of extensive pressure from the Biden White House, YouTube finally 
acquiesced in September 2021 when the company instituted a new content moderation policy to 
remove content that questioned the safety or efficacy of the COVID-19 vaccines. On September 
21, 2021, the YouTube Public Policy Team again reached out to Rob Flaherty with a meeting 
request. The YouTube Public Policy Team asked for a meeting because the YouTube Trust & 
Safety team was “working to finalize a new policy to remove content that could mislead people 
on the safety and efficacy of vaccines” and the company wanted to “preview our policy proposal 
for you and get any feedback you may have.’?!4 A few days later, on September 29, 2021, 
Flaherty responded saying that he would “welcome the meeting” and that the proposal “at first 
blush, seems like a great step.”?!> In subsequent emails, YouTube sent links for Flaherty to 
review the announcement and policy, and they set the meeting for October 1, 2021.7" 


On Wed, Sep 29, 2021 at 9:23 AM Flaherty, Rob R. EOP/WHO 4 @ who.cop.gov> wrote: 
So sorry for not replying to this note. I thought I did. We’d welcome the meeting 
Would love to talk through it — at first blush, seems like a great step. 


-Rob 


From: < dgoogle.com> 

Sent: Tuesday, September 21, 2021 1:52 PM 

To: Flaherty, Rob R. FOP/WHO TE 2 )0.cop gov> 
Ce: < (@google.com> 

Subject: [EXTERNAL] YouTube Meeting Request 


Hi Rob - 


Our YouTube Trust and Safety team is working to finalize a ity to remove content that could 
mislead people on the safety and efficacy of vaccines. We v ike to preview our policy proposal for you 
and get any feedback you may have. Are you available to meet tis Friday (9/24) or Monday (9/27)? 


Best Regards, {2 
= 


313 Iq. 
314 Email from Google & YouTube personnel to Rob Flaherty (Sept. 21, 2021, 1:52 PM); see Ex. 114. 
315 Email from Rob Flaherty to YouTube & Google personnel (Sept. 29, 2021, 9:23 AM); see Ex. 114. 
316 Email from White House staff to YouTube & Google personnel (Sept. 29, 2021, 11:04 AM); see Ex. 114. 
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After the policy change, the company continued to work with White House and CDC 
staff on the rollout of vaccines for children from five to eleven years old.*!” Flaherty reached out 
initially expressing interest in discussing the White House’s strategy for this rollout and “the 
headwinds we think we’re going to be facing.”*!* Flaherty further sought to understand Google’s 
strategy regarding the rollout, and requested a one hour call to find “areas of collaboration.”?!” 
The call occurred on October 22, 2021.°7° 


On Tue, Oct 19, 2021 at 1g:5% eM {EEE zc ogle.com> wrote: 


Happy to, Rob, and addi@e to round out the team. 


hi ut because as you know, we are deep in preparation for the roll out of the vaccine for people aged 5-11. 
hoping to share a bit about our strategy and the headwinds we think we’re going to be facing. We'd also 
download on your plans in this regard across your various surfaces and find areas of collaboration. Would 
© to find an hour to walk through it all at some point late this week or early next. 


LY CONFIDENTIAL HJC-GOOG-00014838 


Hoor can help wrangle times on our end if you have any avail late this week or early next. 


-Rob & 
Rob Flaherty 
Director of Digital Strategy 

The White House 


I _ ~Y 


317 Emails between Rob Flaherty and YouTube & Google personnel (Oct. 19 to Oct. 20, 2021); see Ex. 116. 

318 Email from Rob Flaherty to YouTube & Google personnel (Oct. 19, 2021, 5:36 PM); see Ex. 116. 

319 Td.; see also Email exchange between YouTube personnel and White House staff (June 14 — 16, 2022); see Ex. 
120. 

320 Emails between White House staff and YouTube & Google personnel (Oct. 20, 2021); see Ex. 116; Zoom 
invitation for October 22, 2021 meeting between White House and Google & YouTube personnel (Oct. 20, 2021); 
see Ex. 117. 
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D. 2022: YouTube Continues to Engage with the White House on Misinformation 
Policies Not Related to COVID-19 


Google and YouTube’s collaboration with the White House regarding misinformation 
continued past 2021 and expanded to issues beyond COVID-19 and vaccines.*”! For example, on 
March 17, 2022, Tim Wu, the Special Assistant to the President for Technology and 
Competition, reached out to Google asking for a meeting to discuss “Russian misinformation / 
disinformation” as well as “airline competition.”*”” On June 16, 2022, Google Public Policy team 
sent an email to White House staff briefing them on “YouTube’s climate misinformation 
efforts.”373 On July 14, 2022, YouTube Government Affairs staff contacted White House 
personnel offering to brief them on “updates related to addressing reproductive health 
misinformation on YouTube,’”?”* to which White House staff responded, saying that they were 
“specifically interested in abortion.”3”° And on August 3, 2022, a Google Public Policy staffer 
responded to an email from Rob Flaherty, thanking Flaherty for his ideas pertaining to how 
“Google platforms can help inform and educate voters” and recommended that Flaherty meet 
with the company’s “Left-of-Center elections team” so that he could “dive deeper” into the topic 
of educating voters.*”° 


Once the White House, or any government office, has proven to be able to censor 
information—even if under the purported guise of supporting public health or the integrity of 
elections—it is inevitable that the government will seek to expand its censorship efforts to cover 
an ever-growing list of topics. The Committee and the Select Subcommittee are continuing to 
investigate the extent to which the Biden Administration may have attempted to censor speech of 
other topics, such as climate, abortion, and inflation.>?’ 


321 See also Email exchange between YouTube personnel and White House staff (Nov. 1-2, 2021); see Ex. 118. 

322 Email from Tim Wu to YouTube & Google personnel (Mar. 17, 2022, 4:14 PM); see Ex. 119. 

323 Email from Google & YouTube personnel to White House staff (June 16, 2022, 4:16 PM); see Ex. 121. 

324 Email from Google & YouTube personnel to White House staff (July 14, 2022, 1:16 PM); see Ex. 122. 

325 Email from White House staff to Google & YouTube personnel (July 26, 2022, 10:02 PM); see Ex. 122. 

326 Email from Google & YouTube personnel to Rob Flaherty (Aug. 3, 2022, 1:05 PM); Ex. 123. 

327 See, e.g., Jeff Stein & Taylor Lorenz, The viral $16 McDonald’s meal that may explain voter anger at Biden, 
WASHINGTON PostT (Nov. 24, 2023) (“The White House official said the administration is working with TikTok 
creators to tell positive stories of Biden’s economic stewardship, while also working with social media platforms to 
counter misinformation.”). 
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III. THE AMAZON FILES 


“Ts the [Biden] Admin asking us to remove books, or are they more concerned 
about search results/order (or both)?”>?8 


- Email between Amazon employees (March 9, 2021, 11:59 AM) (on file with the 
Comm.) ahead of Amazon’s meeting with the Biden White House later that day. 


The Biden White House also waged its pressure campaign against online bookstores. In 
March 2021, Biden White House officials criticized Amazon, the world’s largest online 
bookstore, for carrying books that questioned the safety or efficacy of vaccines, including the 
newly developed COVID-19 vaccines. Facing pressure from the White House, Amazon reacted 
quickly, implementing a new policy within a week that would add restrictions to anti-vaccine 
books. 


The Biden White House’s pressure on Amazon shows that despite the purported claims 
of trying to combat viral alleged misinformation on social media, the true purpose of the White 
House’s censorship campaign was to censor disfavored speech, no matter the form it took. To be 
sure, First Amendment protections extend to Americans’ speech on every form of media, but 
navigating how these protections apply to the relatively new forum of social media will require 
time and good-faith debate. But as documents obtained by the Committee and Select 
Subcommittee show, the Biden White House sought to censor speech in one of the oldest forms 
of communications: books. 


A. March 2, 2021: Biden White House Criticizes Amazon For Not Censoring Books 


On March 2, 2021, Slavitt emailed Amazon’s Vice President of Public Policy, asking 
who the White House could talk to about the “high levels of propaganda and misinformation and 
disinformation” on the Amazon’s online bookstore.*”” 


On Mar 2, 2021, at 8:36 AM, i <S © 2 mazon.com> wrote: 


Hi. I’m happy to talk to you all to learn more. We've taken a number of actions to not show misleading content 
on vaccinations so if we’re missing something, please let us know. We can also do a more fulsome briefing 
with our content teams if that’s helpful. 


I’m available at the number below whenever you want to chat or we can schedule if that’s better Thanks, 


38 Internal email between Amazon personnel (Mar. 9, 2021, 11:59 AM); see Ex. 134. 
329 Email from Andy Slavitt to Amazon personnel (Mar. 2, 2021, 7:33 AM); see Ex. 126. 
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The Amazon Public Policy Vice President responded just an hour later to Slavitt and 
offered to provide a “more fulsome briefing with [Amazon’s] content teams” and assured Slavitt 
that Amazon had taken “a number of actions” to avoid showcasing misleading content.*°° Slavitt 
responded just minutes later, noting that he personally ran searches on Amazon and found the list 
of book results as “‘concerning.”**! Slavitt also added Flaherty to the email chain.**? 


From: "Slavitt, Andrew M. EOP/WHO" < @who.eop.gov> 

Date: Tuesday, March 2, 2021 at 8:48 AM 

To: iE © 29.2 200.com> 

Cc: "Butterworth, Zach Z. EOP/WHO" <i who.cop.gov>, "Wakana, Benjamin L. EOP/WHO" 
< ® ).0.c0p.cov>, "Flaherty, Robert EOP/WHO" <Q who.cop.zov> 
Subject: RE: [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


CAUTION: This email originated from outside of the organization. Do not click links or open attachments 


unless you can confirm the sender and know the content is safe. 


If you search for “vaccines” under books, | see what comes up. | haven’t looked beyond that but if that’s 
what’s on the surface, it’s concerning. 


Happy to get briefed but want to understand the data when we do. |’m roping in Robert as well. 


Thanks. 


An hour later, Amazon’s Public Policy Vice President responded to Slavitt’s email, 
reiterating that current policies governing the book’s presence on Amazon’s marketplace were 
being consistently applied across the bookstore, and that such policies were the result of 
extensive research and development.**? The presence of a book whose subject matter involves 
the questioning of vaccine efficacy on Amazon’s bookstore did not currently violate Amazon’s 
policies. 


330 Email from Amazon personnel to White House personnel (Mar. 2, 2021, 8:36 AM); see Ex. 125. 
331 Email from Andrew Slavitt to Amazon personnel (Mar. 2, 2021, 8:48 AM); see Ex. 125. 

332 Iq. 

333 Email from Amazon personnel to White House personnel (Mar. 2, 2021, 2:44 PM); see Ex. 124. 
334 Tq. 
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From: EEE == amazon.com> 

Sent: Tuesday, March 2, 2021 2:44 PM 

To: Flaherty, Robert EOP/WHO <i EE® who.cop.gov>; Slavitt, Andrew M. EOP/WHO 

< Owho.eop.gov> 

Cc: Butterworth, Zach Z. EOP/WHO <I © who. eop.gov>; Wakana, Benjamin L. EOP/WHO 
<2 52. 20.c0v> 


Subject: [EXTERNAL] Re: Re: Re: Following Up 


Hi, Robert. Let me know if you want to chat in more detail. But to give you an overview, we have content guidelines and 
remove products that do not adhere to these policies-- which can be found here for books. Specifically, we not allow 
content meant to mislead customers or that doesn’t accurately represent the content of the book. 


You'll see when you search for books related to vaccines or the coronavirus that we have a clear signpost at the top of 

the search page that links to the CDC page on vaccine information. Additionally, when you click on a particular book to 

look at the product detail page, we again direct customers to the CDC information in a bright bold box up top. So we’re 
surfacing CDC information again for every customer, right at the top of the page. 


We invest significant time and resources to enforce our content guidelines. And we use a combination of machine 


learning, automation, and dedicated teams of human reviewers. If there is content that you think misleads customers on 
vaccines, please let us know. 


AMZN_HJC_0004511 


Robert, if we can follow up in more depth with you or answer any specific questions, |’ll make the team available at your 
convenience. As you know, we very much want to help you get Americans vaccinated. That’s our goal. 


Thanks, 


Amazon’s Public Policy Vice President forwarded Amazon’s latest message from the 
White House to the Amazon Public Policy team, advising that they should “alert the business 
that we have WH attention on this issue” and to further “escalate that I’m being questioned about 
this.”°*> The email would inform the CEO of the Retail division, Dave Clark; the Senior Vice 
President overseeing the Books team, Russell Grandinetti; the Senior Vice President of 
Corporate Affairs, Jay Carney; the Vice President of Global Communications, Drew Herdener; 
Senior Vice President, General Counsel, David Zapolsky; and Vice President of Kindle content 
and the main point of contact for the Books team of the developing situation.**° 


335 Internal email between Amazon personnel (Mar. 2, 2021, 11:46 AM); see Ex. 126. 
236 Jd, 
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From: (= AMiAZ0N/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN= (a 


Sent: 3/2/2021 11:46:10 AM 
To: amazon.com); i © amazon.com] 


Subject: FW; [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


Here is what | sent. | tried to make it more conversational, less formal. 


Now, we should alert the business that we have WH attention on this issue. | think we should send an email recapping 


again to the business team, and | want it to be an email that | can forward to [i cic. 


So let's draft something with that in mind. | want to escalate that I’m being questioned about this. We should use in our 
message to the business team some of Andy's language below. 


Later that morning, another Biden White House official, Zach Butterworth, followed up 
with an email containing a screenshot taken from a subsequent search and noting he did not “see 
any CDC warning.”>°’ 


From: Butterworth, Zach Z. EOP/WHO 

Sent: Tuesday, March 2, 2021 2:53 PM 

To: i -  ® 2) 2200.com>; Flaherty, Robert EOP/WHO <_EEEEEE® who cop gov>; Slavitt, 
Andrew M. EOP/WHO <I © who.cop.gov> 

Cc: Wakana, Benjamin L. EOP/WHO <® who.cop.gov> 


Subject: RE: Re: Re: Following Up 


| oe Thanks for your response. Five minutes ago | searched ‘vaccine’ on Amazon and the attached book was one of 
the first in the stack. When | click on the product page | don’t see any CDC warning. Zach 


<image001 jpg> 


337 Email from Zach Butterworth to Amazon personnel (Mar. 2, 2021, 2:53 PM); see Ex. 125. 
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© Alexandria 22301 Mm | -vecone mh Account &Lists~ & Orders 


= All Prime Video Austin’s Amazon.com TV & Video SuyAgain Prime + Customer Service Best Sellers Browsing History » Get your hom 
Achranced Search New Relnave Best Sellars & More Chitéren's Books Textbooks Textbook Rentats Bost Books of the Month 


audible New: 


Vaccines Are Dangerous - And Don't Work and millions of other books are available for Amazon Kindle. |« 


Anyone Who Tells You Vaccines Are Safe weuntimited 
and Effective is Lying Paperback - March ee ae 


membership. 


Look inside + 


27, 2019 Read with Kindie Uniienit 
by be Vernon Coteman (author 


Buy new: 


FFective is 
Lying ey Ie nase _ delivery: Thursday, Mai 


within 15 bes and 13.4 


Hardcover 


, py In Stock. 
Vernon Coleman As an alternative, the Kind 
The facts about vaccination - a0 thal you can make up your Own mind. Dr Vernon is avaliable now and can be r 
Coleman MB ChB Sc FRS. 969 researching and writing abou! vaccines for any device with the free Kind 
50 years. He has ‘ecture and nurses on the subject. He used fo debate 
vacomation on TY and radio Dut won every public denate and these cays vaccine 


Supporters will no longer debate with him 


Slavitt added in a subsequent email that afternoon that Amazon “caters to people who are 
anti-vax.”3*8 Slavitt added that the Biden White House would be interested in discussing with 
Amazon further, not just about Amazon policies, but also specific “examples like this that are of 
concern.”*° Slavitt concluded the email by stating that only attaching a CDC information panel 
next to books regarding vaccine related matters, “wouldn’t be a great solution,” suggesting that 
more severe steps, such as the removal or demotion of books, may be necessary.*“” 


338 Email from Andy Slavitt to Amazon personnel (Mar. 2, 2021, 3:14 PM); see Ex. 125. 
339 Iq. 
340 Id. 
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From: "Slavitt, Andrew M. EOP/WHO" <Q w ho.cop.gov> 

Date: Tuesday, March 2, 2021 at 3:14 PM 

To: "Butterworth, Zach Z. EOP/WHO" <i who.cop.cov>, 
@amazon.com>, “Flaherty, Robert EOP/WHO" @who.eop.gov> 

Cc: "Wakana, Benjamin L. EOP/WHO" < @who.eop.gov> 

Subject: RE: [EXTERNAL] Re: Re: Following Up 


| CAUTION: This email originated from outside of the organization. Do not click links or open attachments 
| unless you can confirm the sender and know the content is safe 


In fact right above it is the line “Vaccines are dangerous and don’t work” promoting even another book. The site caters 
to people who are anti-vax. 


We would welcome spending time on this with you—not just about policies, but examples like this that are of concern. 
And in my opinion, even a CDC warning wouldn’t be a great solution. 


Amazon’s Public Policy Vice President, having already communicated Amazon’s 
policies on the matter with Biden White House officials, accepted the request for a follow-up 
meeting.*"! 


Sent: Tuesday, March 2, 2021 3:21 PM 

To: Slavitt, Andrew M. EOP/WHO <§iEEEEEEEEE® who.eop.gov>; Butterworth, Zach Z. EOP/WHO 
<I 2 10.00. go>; Flaherty, Robert EOP/WHO <{EE@ who.cop.gov> 

Cc: Wakana, Benjamin L. EOP/WHO <Q © who.ecop.gov> 

Subject: [EXTERNAL] Re: Re: Re: Following Up 


We'd be happy to talk and can discuss any specific examples like what you shared, and also your thoughts more 
generally. Robert, can we set up time this week? 


Thanks, 


Flaherty reinforced Slavitt’s inquiry, emphasizing the White House’s desire to talk about 
Amazon’s content moderation policies related to its bookstore.*4” 


341 Email from Amazon personnel to White House personnel (Mar. 2, 2021, 3:21 PM); see Ex. 124. 
342 Email from Robert Flaherty to Amazon personnel (Mar. 2, 2021, 6:16 PM); see Ex. 124. 


72 


From: Flaherty, Robert EOP/WHO 

Sent: Tuesday, March 2, 2021 6:16 PM 

To: EE © 2 2207. com>; Slavitt, Andrew M. EOP/WHO <S EEE who.cop.gov>; 
Butterworth, Zach Z. EOP/WHO <q © w 


vho.eop.gov> 


Ce: Wakana, Benjamin L. EOP/WHO <Q © who.cop.gov>; Qureshi, Hoor EOP/WHO 


Subject: RE: Re: Re: Following Up 


who.eop.zov> 


‘a 


Thanks. Let’s talk about what your policies are. Want to understand what the lines are here. My colleague Hoor can help 
find us all a time. 


-Rob 


Amazon worked to get a meeting on the books with the White House as quickly as 
possible.*4? The meeting was scheduled for March 9, 2021, exactly one week after Slavitt’s 
initial outreach.*“4 


B. March 2-8, 2021: Amazon Internally Debates How to Handle Biden White House 
“Pressure” 


The Biden White House inquiry on March 2, 2021, set off alarms within Amazon. The 
same morning that Slavitt emailed about alleged propaganda and misinformation, Amazon’s 
Public Policy team reached out to the Books team, the Public Relations team, and others. Within 
hours of the White House’s first outreach on book censorship, Amazon decided, as an initial 
response, to (1) not do a “manual intervention” that day because it would be “too visible”; (2) 
expand the number of search terms that trigger a label redirecting customers to the CDC website; 
and (3) begin developing talking points because Amazon expected the Biden White House to be 
unsatisfied with these initial steps.*4° Besides the technical difficulties with implementing a 
manual intervention, Amazon also was mindful of the critical coverage from other media outlets 
that he company had received for censoring Ryan Anderson’s book, When Harry Became 
Sally. 


343 Email from a White House personnel to Amazon personnel (Mar. 4, 2021, 12:00 PM); see Ex. 131. 
344 Tnternal email between Amazon personnel (Mar. 5, 2021, 10:56 AM); see Ex. 132. 

345 Tnternal email between Amazon personnel (Mar. 2, 2021, 9:42 AM); see Ex. 127. 

346 Td. 
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Sent: 3/2/2021 9:42:52 AM 


To: EE 2 2) 2200).c0-) 


Subject: Books Vaccine Misinformation Policy_020821 
Attachments: Books Vaccine Misinformation Policy_020821.docx 


Ok, a quick update. 


1/ We will not be doing a manual intervention today. The team/PR feels very strongly that it is too visible, and will 
further compound the Harry/Sally narrative (which is getting the Fox News treatment today apparently), and won't fix 


the problem long-term problem because of customer behavior associations. If we completely remove customer behavior 
associations it will break the search. 


2/ I've asked the team to widen the search light flag for COVID-19 CDC website re-direct so that it comes to the top of 
the page on more search keys. They can hopefully implement that today and you should be able to share a screen shot. 


3 / a ¢ tag teaming some reactive messaging for your re policy, response, etc. It won’t be 
satisfactory. The WH will probably ask why we don’t tag the content like FB/Twitter do if we aren’t taking it down. That 
is an option being explored but that we don’t want to disclose to avoid boxing in. 


The attached is the still in flux doc to review withfon March 19. lBcave very direct guidance to the teams to be 
boring and not do anything that is visible and will draw more attention. 


Amazon employees had begun preparing responses for Amazon’s Public Policy Vice President 
to have on hand if pressed by the White House on specific aspects of the company’s policies.*4” 


Fron: A © or azon.com> 


Sent: Tuesday, March 2, 2021 10:20 AM 


10: EE © 2% 2207 com> 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 


Thanks 


Could we work up reactive FAQs to these questions for = call? 


1. Doesn’t this line in your policy include the spread of misleading information about vaccination: “We do not 
allow descriptive content meant to mislead customers” 


re Why don’t you tag books that are not scientifically sound the way FB/twitter tags content. 


Amazon’s prepared talking points demonstrate the company’s application of its policies 
and the intentions behind their development. *“° In contrast to the other Big Tech companies 
receiving censorship requests from the White House, Amazon aimed to clearly distinguish itself 


347 Tnternal email between Amazon personnel (Mar. 2, 2021, 10:20 AM); see Ex. 128. 
348 Tnternal email between Amazon personnel (Mar. 2, 2021, 1:54 PM); see Ex. 128. 
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as a retailer, and not a social media company.*“? Internal documents show that when preparing 
for the upcoming meeting with the Biden White House, Amazon felt it was necessary to defend 
its bookstore policy of allowing a variety of viewpoints. 


From ES © amazon.com 


Sent: Tuesday, March 2, 2021 1:54 PM 


To: EE © 3°220n.com>; EE © amazon.com>; iii 
HEE @ amazon.com> 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 


Thanks MEE, addingll from CRM and a! 


For Q1- this is not something we've had come up in the past and is taking the guidelines out of context. The line cited is 
referring to misleading metadata, typos, image quality issues, etc., not the actual truthfulness of the theories described 
within the text of a book. With that in mind, a possible response would be: 

° No, the line you’re referring to is addressing publishing errors like typos, formatting issues, image quality etc. 
You can review examples of examples of content that's typically disappointing to customers in the Guide to Kindle 
Content Quality which we also include a link to in our content guidelines. 

e Our guidelines address content that is illegal or infringing, generates a poor customer experience, or that we 
otherwise prohibit, such as pornography. Our guidelines do not specifically address content about vaccines. 


For Q2- again this is not something we’ve commented on before, and | think we would avoid making a commitment on 
this now, as we are still debating possibly doing so in the future. | recommend a response along the lines of: 

° We believe that retailers are different than social media communities which means we review the content we 
make available, where we make it available in our store, and how we address content that customers find disappointing. 
° As a retailer, we provide our customers with access to a variety of viewpoints, including books that some 
customers may find objectionable. All booksellers make decisions about what selection they choose to offer and we do 
not take selection decisions lightly. 


On March 3, Amazon began taking measures to address White House scrutiny with hopes 
of “earning us goodwill at the White House.”**° The pressure from the previous day’s 
interactions with the Biden White House were the reason for the new changes. One employee 
emailed: “as part of our ongoing conversations with the White House COVID task force, staff 
alerted us to their serious concerns with the misinformation or anti-vaccination books sold in the 
store.”*>! 


349 Iq 
350 Internal email between Amazon personnel (Mar. 3, 2021, 1:33 PM); see Ex. 129. 
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Fromm: iE © 2mazon.com> 


Date: Wednesday, March 3, 2021 at 1:33 PM 


(o E : :220% <r; I AI a2 207 come 
Cc: i © amazon.com> 


Subject: Vaccination education and Amazon Gateway 


Thank you again for your support to sponsor the Ad Council’s vaccination education campaign. This has been a key 
component in our campaign to earn policymaker trust and help support vaccination distribution and awareness. We are 
continuing to leverage this campaign in outreach to state, local, and federal stakeholders as well as the White House. 


We'd like to ask your consideration to display one of the Ad Council's campaign assets on the gateway. We believe 
providing this content would go a long way in contributing to the campaign, as well as earning Us goodwill at the White 
House, 


More urgently, as part of our ongoing conversations with the White House COVID task force, staff alerted us to their 
serious concerns with the misinformation or anti-vaccination books sold in the store. We will continue to sell these 
books, though we have taken steps to increase the COVID searchlight as well as other DNP measures for the anti- 
vaccination books. 


it is our recommendation that customer education on the front page, would provide better education cover than just 
the searchlight feature, and also help mitigate some of the misinformation concerns we are confronting. | will note a 
similar placement was very effective at the start of the pandemic when we featured the Ad Council’s social distancing 
campaign on the gateway. 


Thank you for considering, and please advise if you are supportive. If so, | am happy to work with your designee to 
access the ad councils assets. 


The same day, as pressures from the White House reverberated up the corporate ladder, 
senior leadership at Amazon remained undecided on how to move forward.*” The head of the 
Books team approved the adoption of a new policy to apply a “Do Not Promote” label to anti- 
vaccination books.** 


32 Internal email between Amazon personnel (Mar. 3, 2021, 7:02 PM); see Ex. 130. 
353 Iq 
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Sent: 3/3/2021 7:02:43 PM 
To: | amazon.com) i © amazon com] 


Subject: Misinformation update 


Quick update. 
BE wants to alert GMB before actioning do not promote, but agrees we should go forward. 


Team is expanding search light keywords. However they are not sure if they can get the content itself 
adjusted but are looking into it. 


and signed off on the gateway but it’s likely a display ad frame on the gateway (which we 
knew). That's going to take a couple days and may not be up by Friday. 


| se agreed to join us when we meet with them. 


At the same time, on March 4, the Books team at Amazon began the process for 
establishing a “Do Not Promote” tag for anti-vaccination-related books.*** Amazon employees 
emphasized the “high priority” nature of the request, and that it stemmed from a need to address 
the “negative feedback” from the Biden White House’s Coronavirus Taskforce.** 


ee 


Sent: Thursday, March 4, 2021 11:48 AM 
To: mazan.com> 


Subject: New CPP rule for Anti-vax books 


ae ver is out of the office, I'm hoping you can help me set up a new DNP class in CPP 


What process do we need to follow? This Is 3 high priority intended to address negative feedback we're getting from the 
Whitehouse’s Coronavirus Taskforce 


| Books 


An email later that same day put the reason for the new policy change in even plainer 
terms: “the impetus for this request is criticism from the Biden Administration about sensitive 


354 Internal email between Amazon personnel (Mar. 4, 2021, 11:48 AM); see Ex. 131. 
355 I 
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books we’re giving prominent placement to.”*°° The email concluded by noting that the request 
“should be handled urgently.”3°7 


(107 I 3200. com> 


Sent: Thursday, March 4, 2021 2:18 PM 
Pamazori.com>; crm-automations <crm-automations @amazon.com> 


Mamazon.cam>; 


BE © 2 2200 com> 


Subject: RE: New CPP rule for Anti-vax books 


C= 2) and Automations 


Hi team, | submitted SIM httos://issues.armazon.com/issues/CRMAUTO-638 to create a new DNP class for anti-vax 
books. The impetus for this request ts criticism from the Biden administration about sensitive books we're giving 
prominent placement to, and should be handled urgently 


Thanks, 


Later that same day, an Amazon employee, appearing to understand the urgency of the 
situation, suggested adding vaccination content from the bookstore to the “Do Not Promote” 
class designated for “extremist” content.*°* By doing so, Amazon could more quickly mitigate 
the prevalence of disfavored vaccine-related books while the team finished creating a new class 
for anti-vaccine books. The same employee also requested that forty-three ASINs—Amazon 
Standard Identification Numbers, used to identify specific products on the Amazon 
marketplace—be added to an internal “Master Tracker Misinformation” list of titles.*°? 


356 Internal email between Amazon personnel (Mar. 4, 2021, 2:18 PM); see Ex. 131. 
357 Iq. 
358 Internal email between Amazon personnel (Mar. 4, 2021, 3:32 PM); see Ex. 131. 
359 Tq. 
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From 
Sent; Thursday, March 4, 2021 3:32 PM 
@Wamazon.com> Wamazon —AL0L0LULU—SY 


@amazan.cam>; Bamazon com> 


@amazon.com> Gonaon con >; ii’ 
@amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


a CPP class to handle ad-hoc requests to block promotion: Shell extremist _DNP, This is handled by 


i. the thread 


AMZN_HJC_0007369 


We'll keep the SIM open to créate a new DNP palicy and class for anti-vax, please keep us Updated when the policy is 


fleshed out. 


On March 5, three days after the initial interaction with the White House and just four 
days prior to the follow-up meeting, the Books team met so that they could “review [the] policy 
proposal to handle anti-vax content in Books.’”* In a transcribed interview before the 
Committee, Amazon’s Vice President of Public Policy testified that his Public Policy team had 
conveyed requests to the Books team to “accelerate” its discussions so that a final decision could 
be made prior to Amazon’s call with the White House on March 9.°°! He also noted that the 
policy had been under consideration for about a month at that point and it was his understanding 
that the Books team was in favor of the policy change.*©” Amazon’s consideration of 
implementing more censorious content moderation policies in February 2021 aligns with 
Facebook, which began to increase its censorship of the manmade theory of the origination of the 
SARS-CoV-2 virus in hopes of appeasing the new Biden Administration.°™ 


360 Internal email between Amazon personnel (Mar. 5, 2021, 10:56 AM); see Ex. 132. 

361 Transcribed Interview of Amazon’s Vice President of Public Policy, H. Comm. on the Judic. (Apr. 16, 2024), at 
99 (on file with the Comm.). 

32 Td. at 28. 

363 Cf id.; Sections I.A and I.B (describing new content moderation policies implemented by Facebook in February 
2021 in the early days of the Biden Administration). 
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ee 


Sent: Friday, March 5, 20217 10:56 AM 


mieetGichimeaws, pin+4 181630714 Pchime.av 
Subject: Vaccine Misinfo Books Polley 
When: Friday, March 5, 2021 §:00 AM-8:50 AM (UTC-08:00) Pacific Time (US & Canada) 


Where: Meeting ID: 4181 63 0714 


Meeting Subject / Agenda: Review policy proposal ta handle anti-vax content in Books 


Critical Attendees: a 
Additional Atendees =o 


Context of Meeting (decision-based, Get input on anti-vax proposal doc 
intorm, get input): 


On March 8, just one day prior to the call with the White House, an Amazon employee 
explained how changes to Amazon’s bookstore policies were being applied “due to criticism 
from the Biden people.”*™ 


34 Tnternal email between Amazon personnel (Mar. 8, 2021, 8:28 AM); see Ex. 132. 
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= > ome eee | 
Sent: 28: Mi 
To: amazon.com); © amazon.com) 


Subject: RE: Vaccine Misinfo Books Policy 
Flag: Follow up 


Did | miss it, or did we remave DNP as an option or part of an option (maybe subsumed by Deny Term List)? 

We're considering DNP as complete, and moved the description to FAQ #2. Due to criticism from the Biden 
people, PP asked us to pursue ‘low hanging fruit options’ prior to our Russ review, and this was one of them, There's a 
separate thread out to Russ asking for his permission to implement prior to our 3/19 meeting, 


What if we're not willing to wait for the Alerts Messaging widget? What would we do in the meantime? The next 4 
months of the vaccine response/adoption are going to be critical 
Search is locking for ways to shorten the lead time on this, but agree 18 weeks is too long. 
i think the next best option is to remove fram sale, 
aa still likes the idea of labeling on its own, but | feet like that’s a half measure that doesn’t tangibly address 


the risk. (Search data shows customers who buy this content are looking for specific books and using high intent queries, 
which means customers will likely continue to consume this content in spite of our warnings, perpetuating the current 
CX — but with more fabels.) 

A third option is to build a labeling CX in parallel with the alerts widget, and Implement in a phased way if we 
can’t speed up the 12-18 weeks estimate, I'm working with search to understand if this can even be done 

I'll add all of this to the doc 


From @amazon.com> 
Sent: Monday, March 8, 2021 6:12 AM 


10 ES © 30.3207. corn> EE © amazon.com> 


Subject: RE; Vaccine Misinfo Books Policy 


Sorry | missed this one! Cool to see where this is headed and | like the chart in the FAQ about how this would apply to 
other misinformation, Couple of questions 

i Did | miss it, or did we remove DNP as an option or part of an option (maybe subsumed by Deny Term List)? 

2. What if we're not willing to wait for the Alerts Messaging widget? What would we do in the meantime? The next 
4 months of the vaccine response/adoption are going to be critical, 


At the same time, the Amazon employees who previously sought senior leadership 
approval to lump vaccination related content into the “extremist” Do Not Promote class, received 
the go ahead to do so.*® 


365 Internal email between Amazon personnel (Mar. 8, 2021, 10:52 AM); see Ex. 131. 
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From fi © 22:09 com> 


March 8, 2021 10:52 AM 


(@amazon.com> a | 
- @amazon.com>; amazon ae 
BE 2 eer, com> Wamazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


AMZN_HJC_0007368 


Ok, we have signoff to proceed with this. Let’s go ahead and add the books below to our DNP class 


i ard others in automations: Given the rule we'll be adding to is an ad hoc class, do you have recommendations for 


how we'd handie a new, broad DNP palicy for anu-vax content? 


Thanks, 


The same Amazon employee who was briefed on the policy changes and how they were 
initiated because of “the Biden people” provided context surrounding the extremist DNP 
classification.*©° The employee explained that it was “intended only for [Amazon Standard 
Identification Numbers] identified by NSOC to contain extremist content, and/or for ASINs from 
extremist publishers.”°©’ While it was not standard policy to do so, the employee explained that 
“siven the urgency of the request, I’m ok with using this class for this purpose once . . ..”°°8 In 
other words, Amazon, at least temporarily, treated books related to vaccine efficacy in a similar 
manner to extremist content just to appease the White House’s demands. 


36 Internal email between Amazon personnel (March 8, 2021, 1:59 PM); see Ex. 131. 
367 Iq 
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Fo © 205220n.com> 


Sent: Monday, March 8, 2021 1:59 PM 
amazon.com>; Wamazon.com>: 
amazon.com>; @amazon.com> 


@amazon.com> 


@amazon.com> 
Subject: RE: New CPP rule for Anti-vax books 


Hi all, apologies for the delay in response here while | was out 


Shell_Extremist_DNP is intended only for ASINs identified by NSOC to contain extremist content, and/or for ASINs from 
extremist publishers, Given the urgency of this request, I'm ok with using this class for this purpose once, but long term 
it would be better to create a new class specifically for anti-vax (or misinformation/harmful medical advice/however we 
want to classify this}. 


Currently, all of our DNP classes (Extremist, Racially Sensitive, and Transgender Youth) are ad hoc and AS|N-based, Once 
NSOC identifies an ASIN, it’s added to the shell class. Is the expectation the same for anti-vax content, or is the request 


here to develop a keyword-based approach to proactively classify new ASINs? 


Regards, 


The email concluded by asking: “Is the expectation the same for anti-vax content, or is 
the request to develop a keyword-based approach to proactively classify new ASINs?”?™ The 
answer provided by another Amazon employee suggested that all new books with a subject 
matter related to vaccinations would be identified by NSOC as violating the new policy and 
added to a DNP class.>”° 


Ca az0) 
Sent: Monday, March 8, 2021 2:05 PM 
@anazoy o>; i 207) 2205 com>; 
@amazon.com>; @amazon.com> 
Damazon.com> 


: @ans00 0)? iE © or s200 n>; iis 
BB ® 28200. com> 
Subject: RE: New CPP rule for Anti-vax books 


Is the expectation the same for anti-vax content, or is the request here to develop a keyword-based approach toa 
proactively classify new ASINs? 
Same expectation, Plan is for NSOC to identify and flag books as violating this policy, and add them to the DNP 


class 


HE is the team able to use this SIM to kick off the effort of building 3 new anti-vax class? 
https://issues.amazon.com/issues/CRMAUTO-638. | think we’ll want a specific anti-vax class, as it’s not yet clear what 
actions we'll take as part of a potential misinfo policy. 


Thanks, 


369 Td. 
370 Tnternal email between Amazon personnel (Mar. 8, 2021, 2:05 PM); see Ex. 131. 
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In the afternoon of March 8, Amazon began building its “Do Not Promote” flag for 
vaccination related content,*”! just six days after White House officials questioned the books 
available on Amazon’s marketplace. 


From: 
Sent: Monday, March 8, 2021 2:38 PM 
@Marnazon.com>; Wamazor  —saaeey 
Bara zon.carr > ES 2 2220 cor — ee 
Bamazon.com> 


Marnazorn.com> 


Subject: RE: New CPP rule for Anti-vax books 


Great, thanks ei That SIM is sufficient. Shell ONP classes are wasy to set up, so Mand | will work on this request 
tomorrow and have ft up and running by the end of the day. The anly remaining action item will be for NSOC to update 


their SOP to call out the new class once we have Jt created 


Regards, 


C, March 9, 2021: Amazon Changes Books Policy Because of White House Pressure 


By the following morning, the “Anti-vax [Do Not Promote] shell class” had been 
created.*”* Forty-three Amazon products, presumably vaccination related books, were 
immediately flagged and assigned for “Do Not Promote” designation.*” 


3/9/2021 11:00:45 AM 


@amazon.com| @amezon or | i. 
(@amazon.com}; @amazon.com} 
amazon.com] 


@amezon <0) i © 2052207, cor) SE © 2ma209.com) 


Subject: RE: New CPP rule for Anti-vax books 


Flag: Follow up 


Hi EB anc | created the Anti-vax DNP Shell class and added the 43 ASINs below, NSOC team can now add ASINs to 
/SC/KindleCRM/Shell_AntiVax_DNP using the 


Regards, 


371 Tnternal email between Amazon personnel (Mar. 8, 2021, 2:38 PM); see Ex. 131. 
3” Internal email between Amazon personnel (Mar. 9, 2021, 11:00 AM); see Ex. 131. 
323 Id 
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On March 9, less than an hour after the “AntiVax” DNP was initiated, Amazon’s Public 
Policy team circulated talking points ahead of the impending meeting with the White House.*”* 
In an interesting insight into what Amazon employees anticipated from the White House, the top 
talking points included the question: “Is the Admin asking us to remove books, or are they more 
concerned about search results/order (or both)?””>”> 


or: as 


Sent; Tuesday, March 9, 2021 11:59 AM 


(EES: 00) TTS : 3:09 


< EE © arm azon.com> 


AMZN_HJC_0006185 


Subject: Pre-Brief for Meeting w/ the White House 


Hi all — here are the notes for our Pre-brief discussion with the White House today 


Thank you 


I. Books Curation and Guidelines 101 =a 


. Top Talking Points (to be made affirmatively) {Is the Admin asking us to remove books, or are 
they more concerned about search results/order (or both)?| 


In the same email, the internal Amazon correspondence speaks to the pressure the 
company anticipated due to the pointed and critical nature of its earlier interactions with the 
Biden White House.°”° 


374 Tnternal email between Amazon personnel (Mar. 9, 2021, 11:59 AM); see Ex. 134. 
375 Id, 
376 Internal email between Amazon personnel (Mar. 9, 2021, 10:05 AM); see Ex. 134. 
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ME = A1AZ0N/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN= 
3/9/2021 10:05:54 AM 

To: | OO ti‘(ité‘é CC 
[bhuseman@amazon.com] 

cc: amazon.com] 

Subject: RE: Pre-Brief for Meeting w/ the White House 


Brian — here is the condensed script for 1:30 


Brian’s Intro: 
« Thank you again for reaching out and flagging your concerns. 


* We are all in this together, and Amazon is working hard, and fast, to be a productive contributor in 
vaccine rollout and education. 


* Across Amazon we have a number of teams and machine learning systems looking at the products in 
our store and enforcing our policies. 


° With respect to our Bookstore. We have content guidelines and we have a large team dedicated to the 
incredible challenge of both creating and enforcing our policies and curating the bookstore, 


The talking points then turned to the anticipated need to defend Amazon’s COVID-19 
related policies from White House scrutiny. The company included additional talking points “IF 
PRESSED IN CONVERSATION” and welcomed more discussions to appease the Biden 
Administration while also attempting to retain a shred of autonomy in the situation.>”” 


° We recognize that COVID vaccination is a wholly new matter, and so we have a team of experts here to 
walk through the steps we have taken. 


° IF PRESSED IN CONVERSATION: these are incredibly challenging issues, particularly as the team looks at 
ongoing data and feedback from global health authorities. If you see something specific related to COVID, we 
welcome your feedback so that we can continue to review and learn. 


Misinformation =x 


* We see misinformation, and misinformation around COVID, as a serious issue, and so across Amazon 
we have taken steps to fight the spread of harmful misinformation. 


° Amazon's marketplace requires that sellers provide accurate information on product detail 
pages and put processes in place to proactively block inaccurate claims about COVID-19 before they are 
published to our store. We've also developed specific tools for COVID-19 that run 24/7 to scan the hundreds 
of millions of product detail pages for any inaccurate claims that our initial filters may have missed. 
Collectively, our efforts have blocked more than 6.5 million products. 


In order to appeal to the Biden administration officials, Amazon included talking points 
that were informed by the tallying of vaccination-related content Amazon removed, including 
10,000-20,000 books.?78 


377 Td. 
378 Td. 
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Other steps we have taken for books (IE 


. For books, we have COV|D-specific policies that have prevented the sale of over [20k (could reduce to 
10k, but checking number)] books. This includes books that were advocating “cures” of COVID and the like. [IF 
PRESSED—try to avoid specifics about vaccine in general, but could if pressed could say that books with a 
primary theme that the coronavirus vaccine is unsafe or unnecessary.] 


° High-risk anti-vax books: We have taken steps to ensure the highest-risk titles are excluded from being 
picked up by our automated merchandising discovery tools. Examples of these tools are Amazon’s Choice and 
Amazon Deals. Specifically, these tools are all part of automated systems that identify highly-rated, well-priced 
products that are available to ship immediately. (those well-known, routinely populated, titles: High risk 
content has the primary purpose of persuading the reader that, against direction from authoritative public 
health sources, one or all vaccines should be avoided because they are unsafe or ineffective.) 


In the talking points, Amazon also claimed to have a “high bar for removing book[s],” 
despite applying broad “Do Not Promote” tags and removing tens of thousands of vaccine 
related books from its market.?” 


. Books are unique, and an important part of Amazon's DNA. We are going to sell controversial books, as 
all libraries and other bookstores do. We have a high bar for removing book selection at Amazon and we do 
not take these decisions lightly. 


Content Guidelines: 


° [if pressed—reactive] The Content Guidelines for Books are intentionally broad. In any content 

moderation system there is a push/pull between broad enough to provide discretion in decision making and 
specific enough to provide guidance on what is allowed. Being too specific results in the need to make more 
public changes and can allow authors to game the system. Being too broad risks being accused of lack of any 


decision making framework. We review both our Guidelines and our approach to curating Amazon’s bookstore 
regularly. 


° We design our policies so that decisions can be made as consistent as possible and based on objective 
criteria that is applied to the facts and content. We value having a wide variety of content that includes 
disparate opinions and content that contributes to the information and debate in an open and free society. To 
do this, we focus on creating policies that are narrowly-tailored to the risks we're solving for and 
implementing procedures that ensure we’re making fact-based and consistent decisions. 


Finally, the internal Amazon talking points for the Biden White House meeting 
concluded with responses to specific questions that Amazon expected to be raised in the March 9 
meeting.*°° 


379 Td. 
380 Td. 
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Your public-facing content guidelines state that you do not allow “descriptive content meant to mislead 
customers.” How do vaccination misinformation books not violate this policy? 


The descriptive content refers to how a product is described, not the content within the book itself. In an 
extreme example, if a book said that it was appropriate for young children, but the book itself contained adult 
content, then it would be misleading as to what a customer is buying. 


Why don’t you tag misinformation books the way Facebook and Twitter tag misinformation posts? 

Books are different than social media. They are generally long form and the person would need to purchase the 
book and read the information. Social media is usually quick bites, and sometimes memes. All customers 
customers have an opportunity to post reviews and provide feedback on books, 


By the start of the March 9 meeting with the White House, Amazon’s new book policy 
was in place. 


Emails subsequent to the meeting demonstrate that Amazon continued to further consider 
ways to reduce visibility of books disfavored by the Biden Administration. For example, on 
March 12, 2021, an internal Amazon email discussed an upcoming meeting to “take a closer look 
at books related to vaccine misinformation and debat[e] additional steps Amazon might want to 
take to reduce the visibility of these titles.”°°! The email concluded by noting that Amazon’s 
Public Policy team was “feeling pressure from the White House Taskforce on this issue.”>°? 


Fron: as © 
Date: Friday, 12 March 2021 at 14:47 

To: Ty Rogers 
Cec: 


2n.cOMm> 


@amazon.com> 


RS © 22200 com>, 
@®amazon.com>, @amazon.com> 


Subject: Heads up- upcoming negating Buzzfeed story on Covid 19 book 


Ty- heads up that we anticipate Buzzfeed will run a negative story looking at Covid-19 related books for sale on Amazon 
The story touches on many of the points we've seen raised over the last year and | worked closely with CC's team for the 
points related to Search, Reviews, and Personalization. 


Related to this topic, the Books team has a meeting on 3/19 with ii i and David Z to take a closer look at books 
related to vaccine misinformation and debating additional steps Amazon might want to take to reduce the visibility of 
these titles. The Books Content Risk Management team is still working on their doc for the 3/19 meeting, but | would be 
happy to share non-final draft if you’re interested. 


HE ave been our close counterparts on this one, as PP is feeling pressure from the White House 


Taskforce on this issue as well. 
Let me know if you have any questions or if this needs to go further up the flagpole. 


Thanks, 


381 Internal email between Amazon personnel (Mar. 12, 2021, 2:47 PM); see Ex. 135. 
382 Iq. 
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IV. EPILOGUE: THE DEVASTATING CONSEQUENCES AFTER SUPPRESSING FREE SPEECH 


Flaherty, Slavitt, and other key members of the Biden White House censorship regime 
ultimately moved on and left their roles in the White House.**? About a week after leaving the 
White House, Slavitt published a book, Preventable: The Inside Story of How Leadership 
Failures, Politics, and Selfishness Doomed the U.S. Coronavirus Response.**™ In Preventable, 
Slavitt appeared to criticize Americans who spoke out, at times passionately, against the 
constitutional violations committed during the pandemic: “But, even accounting for [President] 
Trump, other deep-seated issues that are part of our culture and national identity emerged to 
haunt us: Our obsession with individual liberties, even at the expense of others’ lives and 
health.””38> 


Slavitt’s candid statement underscores the Biden White House’s arrogance and its 
contempt for fundamental civil liberties. The Constitution is not suspended in times of crisis. The 
First Amendment did not hurt Americans’ “lives and health”; to the contrary, if the Biden White 
House and the Biden Administration had abided by the First Amendment, so much needless pain 
and suffering could have been avoided. Because public health measures could not be fairly 
debated by the public and assessed on their merits, the Biden Administration and other 
policymakers imposed public health measures that were devasting to schoolchildren, workers, 
and other Americans around the country. Today, it is widely accepted how foolish these 
measures were.**° Statements accepted as gospel under a mantra of “Trust the Science” have 
now been revealed to have had no scientific basis whatsoever.**’ And yet, for a time, the truth 
was censored and the misinformation was spread by the “experts,” including the Biden 
Administration.*** America needs to have free and open debate on the pressing issues of the day, 
and the Biden Administration should have trusted the intelligence of the American people to 
make up their own minds. 


Investigating constitutional violations by the Executive Branch is not enough; legislative 
reforms are needed. House Republicans are working to enact new legislation that would further 
strengthen Americans’ right to free expression. Members of the Select Subcommittee have 
introduced the Free Speech Protection Act and the Censorship Accountability Act, which will 
hold federal employees accountable for violating Americans’ First Amendment rights. 


383 Nick Stoico, North Reading native Rob Flaherty to serve as deputy manager of Biden reelection campaign, BOS. 
GLOBE (Aug. 8, 2023); Maeve Sheehy, Andy Slavitt stepping down from White House Covid-19 response role, 
POLITICO (June 9, 2021). 

384 Andy Slavitt, PREVENTABLE: THE INSIDE STORY OF HOW LEADERSHIP FAILURES, POLITICS, AND SELFISHNESS 
DOOMED THE U.S. CORONAVIRUS RESPONSE (St. Martin’s Press, 2021). 

385 Jd. (emphasis added). 

386 See, e.g., Sarah Mervosh, Claire Cain Miller & Francesca Paris, What the Data Says About Pandemic School 
Closures, Four Years Later, N.Y. TIMES (Mar. 18, 2024) (“The more time students spent in remote instruction, the 
further they fell behind. And, experts say, extended closures did little to stop the spread of Covid.”). 

387 See, e.g., The Editorial Board, Anthony Fauci Fesses Up, WALL ST. J. (Jan. 11, 2024) (“Officials nonetheless 
promoted the arbitrary rule because they didn’t trust Americans to understand scientific nuance or, for that matter, 
anything. Businesses, churches and schools that weren’t forced to close had to spend money reconfiguring their 
operations to comply with these government guidelines. It’s nice of Dr. Fauci to acknowledge now that the rule 
lacked a scientific basis.”). 

388 See, e.g., Calvin Woodward & Hope Yen, Biden goes too far in assurances on vaccines, ASSOCIATED PRESS 
(July 22, 2021). 
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Legislative reforms like these will help ensure that the First Amendment and America’s tradition 
of free expression meaningfully endures. As the legislative process continues, the Committee and 
the Select Subcommittee will continue their oversight efforts to inform these necessary and 
important legislative reforms. 
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Facebook Files 


Exhibit 1 


Email correspondence between 
Facebook, Biden-Harris Transition 
personnel 


From </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN= 4 1 > 

To: 

Sent: 11/30/2020 8:45:35 AM 

Subject: FW: Facebook and the Covid Pandemic 

Attachments: Facebook COVID19 Response Memo[1].docx 


From: Nick Clegg <{ij@fb.com> 
Sent: Sunday, November 22, 2020 8:49 PM 


To: @ com; revolution.com; cranemere.com> 
Ce: @fb.com>; fb.com> 


Subject: Facebook and the Covid Pandemic 


Dear 

Facebook is keenly aware of the tremendous challenge posed by the ongoing pandemic as 
President-Elect Biden prepares to take office in January. Mark has asked me to communicate our 
desire to help and partner with the incoming team. Below and attached please consider a proposal 
for how we believe we can provide meaningful assistance to your efforts. And also please consider 
this an opening to a conversation—we would appreciate hearing from the team how they believe we 
could be helpful in addition to what we propose here. 

Congratulations once again, and we look forward to being in touch with whomever you believe would 
be appropriate on your teams. 

Sincerely, 

Nick 


Facebook COVID19 Response Memo 


We'd like to offer our support for the incoming administration’s COVID19 response goals and meet to 
better understand your priorities. Based on demonstrated impact so far working with governments 


can have unique and significant positive impact on public health are: 


1) Large-scale national behavior change campaigns to get >90% of the US population regularly 
wearing masks, >70% willing to get a COVID-19 vaccine, and XX M vaccinated by end of 

2021. We know from previous work on Health that proactive behavior change efforts can affect 
behaviors in meaningful, positive ways: when we rolled out our Blood Donations tool in the US last 
year, our partners saw a 19% increase in first-time donors showing up at blood banks countrywide. 
Partners have also seen promising results from their COVID19-related campaigns, including around 
“socially norming” behaviors like mask wearing and helping people find places to get care (e.g. the flu 
vaccine). 


2) Extending our ongoing Health Surveys work to provide the CDC with a nationwide real-time 
COVID19 data/monitoring system to assist with a) earlier detection of the spread of hotspots; b) 
gauging adoption of preventive health behaviors (e.g. mask wearing + vaccine uptake), and c) 
identifying gaps in healthcare access, especially in underserved populations (e.g. low vaccination 
rates or access to testing). Our ongoing health surveys have run at an unprecedented scale since 
April and are already being used to inform decisions in many areas. 
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That said, we'd appreciate the opportunity to meet and discuss what you'd view as most helpful with 
the right people on your team. Our most successful collaborations involve deep engagement with 


governments and partner NGOs: we find it most beneficial when these partners can give us clear 
priorities and goals, and we can work together to determine which of those goals Facebook Inc. is 
most uniquely suited to support. 


Below is more detail about our existing efforts, which are focused on two core themes: 


1) Connecting people with credible information and support, and reducing misinformation. We 
have helped connect over 2B people worldwide to resources from health authorities like the WHO or 
CDC through products like the COVID19 Information Center (CIC) on the Facebook App (FB App), 
promotional campaigns across FB App and Instagram, and WhatsApp and Messenger helplines. We 
highlight the CIC in search, when people share content about COVID19, and in News Feed. We and 
partners like the CDC have run large-scale (100s of millions of people), worldwide campaigns to 
encourage behaviors like physical distancing, mask wearing, and flu vaccinations. We've also 
extended a significant amount of ad credits to organizations like WHO and health departments in the 
United States to advance their health communication objectives. The government of Singapore’s 
WhatsApp COVID19 helpline reached 900,000 signups in 10 weeks (per the Singapore MoH) in a 
country with a population of 5-6M; this was a component of their overall health communications 
approach. In South Africa, the Ministry of Health’s COVID19 digital response program on WhatsApp 
reached 6.2M unique users (and 750k daily users) in 7 weeks (per Praekelt), This builds on the 
success of the MomConnect Health messaging program, which rolled out on WhatsApp in late 2017 
and (per Praekelt) has enrolled around 65% of all expectant mothers in the country. 


We know from previous work on Health that proactive behavior change efforts can reach unique scale 
(in the US, 60-70% of adults use Facebook) and, more importantly, affect behaviors in meaningful, 
positive ways: when we rolled out our Blood Donations tool on FB App in the US last year, our 
partners saw a 19% increase in first-time donors showing up at blood banks countrywide; partners in 
other markets (e.g. Pakistan) have seen even larger offline impact. We have seen encouraging 
directional data from COVID19 preventive behavior efforts. Given the importance of normalizing 
individual, voluntary behavior change—including many “first time” behaviors in the US (e.g. mask 
wearing, limiting close contacts, vaccination)—we believe there is significant potential in further 
leveraging these approaches in the coming months. 


We recognize that while we can never get misinformation to zero—given we are in many ways a 
reflection of society—we do have a responsibility to reduce our amplification of it. Since January, we 
have removed over 12M posts of expert-consensus misinformation about COVID19 that could cause 
harm, and separatelylabeled 167M posts that contain misleading information. When people see 
misinformation about COVID19 that is later removed, we inform them and connect them to information 
from credible sources like the WHO. We have also added a screen linking to the CIC whenever 

anyone shares content about anyone shares content about COVID19 on FB App. People want what is best for themselves and their 
loved ones, and helping connect with trusted information reduces misinformation and increases 
preventive behaviors. 


2) Providing experts with data and tools to inform decisions. In partnership with Carnegie Mellon 
University (CMU), University of Maryland, Massachusetts Institute of Technology, and Johns Hopkins 


University (JHU), we have been running uniquely large-scale (30M+ responses since April), ongoing 
(50,000+ responses per day), near-real-time (many responses are available on a ~1-2 day lag) opt-in 
surveys to Facebook users on COVID19 symptoms, knowledge/attitude/practices, care-seeking, and 
mental health. Aggregate data for many of these are available publicly by state, HRR, and county in 
the United States. These surveys are informing a wide variety of policy decisions. For example, mask 


wearing questions are one of the primary sources of longitudinal understanding of these behaviors 
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worldwideand have been used by IHME (including being incorporated into their weekly COVID19 
results briefing) as well as some governments. In the US, there remains significant state-to-state 
variation in self-reported mask wearing rates (e.g. WY was at ~70% vs. CT at ~95%), longitudinal 
trends (e.g. SD has increased 20% in the last 2 months), and demographics (¢.g. men are less likely 
to report wearing masks than women). Our Preventive Health Survey has been used by Risk 
Communication and Community Engagement (RCCE) networks worldwide, including in India and 
Indonesia, with dissemination occurring through JHU and WHO. This survey includes questions on 
COVID19 vaccine confidence and level of trust in different information sources (e.g. health officials, 
journalists, politicians). Survey symptom data exhibit promise in earlier detection of outbreaks (esp. 
where case data testing are sparse or delayed) and are starting to inform syndromic monitoring efforts 
in the US (via CMU) and elsewhere; to accelerate learnings and applications, we are running 

a Symptom Data Challenge in partnership with CMU, UMD, Duke Margolis, and Resolve to Save 
Lives. The scaled survey approach also enables rapid, adaptable situational awareness to meet 
evolving data needs (e.g. CMU added mask wearing questions after it became clear there was a data 
gap here; the same approach could be applied to help understand testing availability or vaccine 
attitudes/behaviors). 


In addition to our survey work, we also have an Al team focused on better forecasting of 

cases, drawing from non-Facebook public data as well as public aggregate data from the Symptom 
Survey. They recently released county-level case forecasts for the US with consistently strong 
performance relative to state-of-the-art models. We are partnering with the Universitat Politecnica de 
Catalunya to see how similar forecasting techniques can be applied in Europe; our work are already 
incorporated into periodic reports to the European Commission (EC). 


Lastly, we have a long-running Disease Prevention Map program that shares aggregated co-location, 
mobility, and social connectedness data. Data from this program has been used by governments 
worldwide to understand aggregate population behaviors (¢.g. compliance with stay-at-home orders 
or movement restrictions) and inform modeling. 
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Exhibit 2 


Email correspondence between 
Facebook, Biden-Harris Transition, and 
the White House 
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From: aie </O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=DF1BAA17A67B40A4BA85441653B797B2> 

To: Rowe, Courtney M. EOP/WHO; Peck, Joshua (HHS/ASPA); Flaherty, Robert EOP/WHO; 
Humphrey, Clarke EOP/WHO 


cc: 
Sent: 2/2/2021 10:45:51 PM 
Subject: Re: [EXTERNAL] Re: Thanks-- 


Good morning Courtney, Josh, Rob and Clarke, 
| hope all is well. 


| wanted to follow-up to determine if you have had a chance to review the note below. Our teams suggested 
several areas we could have a deeper conversation on in an effort to help support the nation’s COVID-19 
vaccination efforts. 


Best, 


From: fb.com> 
Date: Tuesday, January 26, 2021 at 2:21 PM 


To: "Rowe, Courtney M. EOPAWHO" < who.eop.gov>, "Peck, Joshua {HHS/ASPA)" 
SEE ohhs.gov>, "Flaherty, Robert EOP/WHO" EEE 15.600 go> 
"Humphrey, Clarke EOP/WHO" _ Sane 

ES <.-- abr or 


Ce: 
Subject: Re: [EXTERNAL] Re: Thanks-— 


Good afternoon Courtney, Josh, Rob and Clarke, 


Thank you for the call on January 19, just before the inauguration. Congratulations on a memorable ceremony. We 
are excited to work with you all on our proactive education campaigns to build confidence in COVID-19 vaccines. 


Facebook has been meeting with the CDC weekly on Wednesdays (3pm Eastern} for the last year to coordinate 
on COVID-19 initiatives and pull in relevant teams to leverage our platform in disseminating CDC’s latest quidance 
to the right populations. We remain eager to help the Administration get out health messages around COVID-19 
and vaccinations and woud like to set up a weekly meeting with you/HHS to move forward on the vaccination 
work. 


As part of our parting discussion, we offered to follow up with you all on a few of the work streams we have that 
support your mission. You will find those below. We also offered a quick sync on how we have been working with 
the White House, HHS and CDC and other key departments we are partnering with which we can do when we meet 
again. 


Do let us know if you have questions about the information below and dates and times that work for a weekly 
meeting. 


Health partnerships for campaigns and health 
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insights 


Over the past year, we’ve worked with both health organizations and influencers to drive campaigns on topics like 
mask wearing, social distancing, getting vaccinated for the flu and more. We've found compelling evidence 
suggesting that these campaigns can influence people’s attitudes and behaviors. Here are some tactics we and our 
partners have found to work quite well {keeping in mind that there are no hard and fast rules!): 


¢ Health organizations (nonprofits, academic institutions, etc.) 

© Health messages that show people a positive action they can take to improve their health are often 
more motivating than fear-based messaging. 

o Health messages that dispel concerns about safety have been especially effective for vaccine 
campaigns — for example, one of our partners’ most successful flu vaccine campaigns was centered 
around the message, “No, you cannot get the flu from the flu shot.” 

o Many of our partners say they get the best results when designing campaigns with the explicit goal of 
creating content that viewers will want to share with their friends and family. This enables them to get 
much broader reach/distribution and also capitalize on the fact that people often trust guidance that 
comes from their friends and loved ones. 

© Using interest-based targeting for health messaging campaigns has also been successful; one of our 
partners was able to move the needle around mask-wearing attitudes/behaviors in the US through a 
campaign where they served different creative to different audiences (e.g., parents with children, 
Spanish speakers, and rural moderates saw very different content, but all with the central ‘wear a 
mask’ message). 

¢ Other influencers (including public figures} 

o Engaging celebrities to share content of themselves wearing a mask has been one of our most 
successful interventions to-date. This summer, we reached out to our public figure partners 
encouraging them to post content of themselves on Facebook and Instagram with the #WearAMask 
hashtag. We then amplified this content to reach more people on our platforms. The campaign led to 
an 8 point increase in perceived social approval {a key indicator of behavior change) to wear a mask 
among people who viewed the content. 

o Note: We've received feedback from our partners that these campaigns would be even more 
successful if the ask to engage in health campaigns came from a health authority — like the CDC or 
HHS — instead of from Facebook. This is a key area of partnership that we'd like to explore with your 
team moving forward: for example, if you are able to help activate influencers and partners for 
campaigns, we can quite easily amplify the content they post to specific audiences. 

e We are also working with some of our partners on COVID-19 vaccine message testing to determine which 
messages resonate with different communities. One of the partners we're working with here is the 
Behavioral Insights Team (BIT), an organization that applies nudge theory to inform policy and public 
services. They recently ran an online experiment to test 7 different messages promoting vaccine confidence 
and willingness to vaccinate in the US. The Trust building message they tested had the strongest results 
overall, both among general populations and Black Americans. The specific message that performed the 
best was: “The COVID-19 vaccine was developed for safety before speed. Over 70,000 people have 
already tested it, so you can get it safely.” BIT has permitted us to include the full results here, attached, in 
case these can be helpful to you as you design your campaigns — and we're also happy to discuss further. 
In late December, we met with senior CDC career staff around educational campaigns and survey data {our 
CMU COVID survey below). They immediately understood the value of what we were offering and are 
interested in collaborating more closely. They are interested in using our large-scale surveys to inform the 
vaccine response and we are in active discussions on educational campaigns. The meeting was positive 
and completely focused on substance and impact. 


WhatsApp 


e WhatsApp’s vaccine support strategy is to partner with governments, health ministries, global health 
authorities and key healthcare industry stakeholders to provide tools on WhatsApp to help citizens get 
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educated about COVID-19 vaccines, schedule their appointments and get critical updates to get vaccinated. 

e In 2020, WhatsApp partnered with the WHO, UNICEF and 100+ governments/health ministries around the 
world to send critical updates about COVID-1$ out to citizens. These efforts positively impacted the lives of 
tens of millions of people with over 3 billion messages exchanged between citizens and governments. 

e In 2021, WhatsApp has established partnerships with the WHO and UNICEF, and is pursuing partnerships 
with dozens of governments around the world to provide critical last mile support to ensure that people get 
accurate information about COVID-19 vaccines and get vaccinated. For example, WhatsApp recently 
partnered with the Ministry of Health in Indonesia to enable people register and get important reminders to 
get vaccinated. The service was rapidly adopted, with 500,000+ health workers signing up for the service in 
the first few days of launch. 

« Inthe US, WhatsApp is seeking to: 

o Partner with the CDC, HHS, and key health authorities at the state/local level to empower people 
on WhatsApp (particularly those in the Latin-X and immigrant/minority communities where WhatsApp 
usage is high) with accurate information about vaccines, enable people to schedule their vaccine 
appointments, and send critical updates to remind people to receive their required number of vaccine 
doses. 

o Leverage Facebook/Instagram ads that click to WhatsApp campaigns to reach millions of people 
in the US who can engage directly on WhatsApp with the CDC, HHS, and key health authorities at the 
state/local level. 

e WhatsApp also has an on-going partnership with the Poynter Institute/International Fact Checking 
Network on a fact checking WhatsApp service to combat COVID-19 misinformation in English and Spanish. 
WhatsApp will continue to accelerate this partnership with planned efforts to educate US citizens in 2021 by 
combating vaccine related myths and rumors on WhatsApp. 


CrowdTangle 


¢ Bi-weekly COVID content reports: We have recently begun sharing bi-weekly COVID content reports with 
the CDC. The goal of these reports is to share emerging trends, particularly around content to “watch out” 
for, and provide some localized views on potentially problematic content. Facebook’s CrowdTangle tool is 
used to develop these reports. CrowdTangle is looking at public content only, and analyzes a database that 
incldes a subset of Pages, verified Profiles, public Instagram accounts and Groups. Thus, these reports 
should be directional and not be the sole source of information or be considered the definitive look at all 
problematic content on the platform. 

« Access to CrowdTangle: At the start of the pandemic, CrowdTangle has been in use by the CDC for 
research and social media monitoring purposes. FEMA has been a user of CrowdTangle since 2015, and 
has used it to create real-time displays for their various regional teams to support their social media 
situational awareness efforts and help direct needs or information clarification. The CrowdTangle team has 
supported these two agencies with trainings, product resources, and list building assistance. 


Facebook Ads 


® Supporting government organizations, such as Governments or Ministries of Health, with communication 
related to COVID-19 became a top priority for us as a company. We mobilized multiple dedicated response 
teams — including measurement (marketing science} — and worked closely with Facebook Marketing 
Partners (FMPs) to ensure that people were adequately informed by their governments and knew where to 
go for resources. VWWe’ve provided more than $35M worth of ad coupons and extensive training and 
consultation on how to leverage ad credits to more than 230 government entities in over 150 countries. This 
enabled governments to get their most important COVID-19 messaging across to as many people as 
possible. 

e Inthe US specifically, as part of our we have maintained a very close working relationship with CDC, 
including weekly meetings to discuss policy, communications and advertising related topics. CDC has been 
a recipient of our ad credit program, allowing them to reach people with essential health messaging. They 
are launching their first measurement study imminently to measure the effectiveness of their media on 
changing knowledge, attitudes and practices. 
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e Similarly, cur team has also been working closely with HHS and their media agency on their “Slow the 
Spread” campaign, and working on launching our first Brand Lift study to understand attitudinal and intent 
shifts around their latest “Stop the Spread” campaigns. 


Ad Council Partnership 


e For over 75 years, The Ad Council has been distributing important public service announcements in 
partnership with government agencies and nonprofits. 

« Ad Council announced in late November 2020 in The New York Times that it will be working towards a 
commitment to meet the marketing and communications challenges associated with vaccine confidence and 
adoption. Facebook, along with many other corporations and NGOs, is partnering on this effort through 
funding and on platform support. The funding partnership was recently highlighted in the press. 

e Facebook is working with Ad Council as an in-market messaging research partner by donating ad credits, 
digital-first creative as well as media and measurement support for the Ad Council’s work with the NGO 
community to help build people's confidence of the COVID-19 vaccines. Facebook will work with Ad Council 
to release high level results from this initial effort as well as creative assets to make available for other 
organizations to leverage. From these learnings, Ad Council will work with Facebook to launch a larger 
spring campaign to drive vaccine confidence through donated ads on the platform. 

e In 2020, Facebook donated over $1 million in ad credits to Ad Council to support campaigns around 
COVID-19, often in partnership with the CDC and HHS, which focused on mask wearing, social distancing, 
dismantling stereotypes about the virus and other topics. 


Vaccine Data/Survey 


Here are some more details on the CMU / Facebook survey. 


As of last week, CMU has updated their public AP| and map to reflect vaccine intent data from the current version 
on the instrument in the US. We believe this is the largest scale and most granular source of public data for 
vaccine intent that exists {in the US, we’re averaging 100s of Ks of responses / week since April across many 
languages). 


It has: 

1} Daily granularity (allowing faster understanding of changes in trends} 

2) County and zip-code level resolution (allowing faster understanding of local differences) 

3) Sociodemographic resolution--including age, occupation, and race/ethnicity {allowing for clearer understanding 
of intent by vaccine priority populations--like healthcare workers or 65+ or those with diabetes/cancer/etc.--as well 
as helping inform equity efforts) 


Not all of these aggregations are available publicly, but microdata access are available for free under DUA to 
academic and nonprofit institutions. If there are specific aggregations that are a top priority for you, we can work 
with the academic partners to surface them publicly over API or CSV. We've been engaging with the CDC on this 
survey as well. Documentation of the full survey instrument is here; the latest instrument as well as an overview of 
the broader survey effort are attached via PDF. 


In addition to intent, there are also now questions around vaccine rates, so similar maps can be generated around 
% of population that report having gotten vaccinated worldwide by country (or subpopulations, like 65+, healthcare 
workers). 


The same survey has been used for months by organizations like IHME to track mask wearing rates. Here’s a 
deep-dive on its utility and limitations for this use case by our partners at CMU. Cyrus Shahpar and colleagues at 
Resolve to Save Lives should be fairly familiar with some of these data as well. 
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On behalf of our broader team, 


FACEBOOK 


U.S. Public Policy 
Facebook 


From: TE o£.com> 


Date: Friday, January 22, 2021 at 2:11 PM 

To: "Flaherty, Robert EOP/WHO" EE 220. c0p.gov>, Theo LeCompte 
HB jb rot.org>, "Humphrey, Clarke EOP/WHO" <I who. eop.gov> 
Ce: "Peck, Joshua (HHS/ASPA)” <onns.gov>, "Rowe, Courtney M. EOP/WHO" 


< who.eop.gov>, ES f.com> 
Subject: Re: [EXTERNAL] Re: Thanks-- 


Great—thanks Theo and Rob. Also adding my colleague Good to be in touch here. | know we are 
preparing to send over some data related to our initial conversation—we will be back ASAP. 


In the meantime, please let us know how we cen be helpful. 


From: Flaherty, Robert EOP/WHO 
Date: Friday, January 22, 2021 at 2:06 PM 


To: Theo LeCompte jorpt.org>, EG t>.com>, Humphrey, Clarke 
EOP/WHO < who.eop.gov> 


Ce: Peck Joshua (HHS/ASPA) {MM @hhs.gov>, Rowe, Courtney M. EOP/WHO 
who.eop.gov> 
Subject: RE: [EXTERNAL] Re: Thanks-- 


7 


I'm adding Clarke in here as well on COVID stuff. Looking forward to engaging on this and other workstreams. 


@who.eop.gov> 


-Rob 


From: Theo LeCompte orpt.org> 
Sent: Friday, January 22, 2021 2:02 PM 


To: Dfb.com> 
Co: Peck Joshua (HHS/ASPA) <M @hhs.cov>; Rowe, Courtney M_EOP/WHO 
who.eop.gov>: Flaherty, Robert EOPAWHO < who.eop.gov> 


Subject: [EXTERNAL] Re: Thanks-- 


Following up on our conversation earlier this week, connecting you here with official government emails for Josh, 
Courtney, and Rob. 


Again, it was a pleasure to work with you and hope fo have the chance to do so again. 
Theo 
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On Tue, Jan 19, 2021 at 10:49 PM [© tb com> wrote: 


Great—thank you! Good luck tomorrow. 


Get Outlook for iOS 


From: Theo LeCompte <| jbrpt.org> 


Sent: Tuesday, January 19, 2021 10:20:34 PM 


Subject: Re: Thanks-- 


Hey i 


Thank you - pleasure working with you as well. 


Yes - wil connect you with Courtney and Josh on the ad side as soon as they have .gov emails, and | know Rob 
and Clarke will want to be in touch on the mis/disinfo side. 


Best, 
Theo 


On Tue, Jan 19, 2021 at 4:03 PM fb.com> wrote: 


Theo, 


Thanks for all of your help throughout the transition pertod—wishmng you well in your next chapter now that the 
transition is drawing to a close. 


Hoping to be in touch with Courtney and Josh as we are now heading into the new administration—I'd be 
grateful if you'd connect me as they Jand with new email addresses in the coming days? 


Thanks, 


Theo LeCompte 
Bider-Harris Transition 
Private Sector Engagement 


Theo LeCompte 
Bider-Harris Transition 
Private Sector Engagement 


109 
CONFIDENTIAL TREATMENT REQUESTED - META-1 18HJC-0007492 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Exhibit 3 


Email correspondence between 
Facebook and the White House 
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STRATIVE GROUP 


From: GR «0 =F HEFAceBooK/0U=EXc 


(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN= 3F> 

To: Humphrey, Clarke EOP/WHO; Verma, Garima EOP/WHO; Flaherty, Robert EOP/WHO; Tom, 
Christian L. EOP/WHO; Palermo, Rachel E. EOP/OVP 

Sent: 2/8/2021 10:37:26 AM 

Subject: COVID Updates 


Hi All, 

Flageing this for all of you: 

TLDR: We will be running the largest worldwide campaign to promote authoritative COVID-19 vaccine 
information and expanding our efforts to remove false claims on Facebook and Instagram about COVID-19, 
COVID-19 vaccines and vaccines in general during the pandemic. More details are in our Newsroom: 
authoritative COVID-19 vaccine information and COVID-|9 and vaccine misinformation. 


Ful details below/in those posts, and let me know if you have Qs. 


facebook, inc. 


| 


politics & government 
@fb.com 


Wanted to make sure you saw our announcements today about running the largest worldwide campaign to 
promote authontative COVID-19 vaccine information and expanding our efforts to remove false claims on 
Facebook and Instagram about COVID-19, COVID-19 vaccines and vaccines in general during the pandemic, 
More details are in our Newsroom: authoritative COVID-19 vaccine information and COVID-19 and vaccine 
nusintormation. 


Hi there, 


Helping People Find Where and When They Can Get Vaccinated 
e Starting this week, we'll feature Itnks in the COVID-19 Information Center to local ministry of health 


websites to help people understand whether they ‘re eligible to get vaccinated and how to do so, 
e And in the coming weeks, as more information becomes available, we'll continue to improve this feature, 
making it easier for people to see where and when they can get vaccinated in just a few taps. 


Sharing Credible Information About COVID-19 Vaccines 

e We re working with health organizations and community leaders to run campaigns on our platform 
promoting accurate information about COVID-19 vaccines and encouraging people to get vaccinated. 

e We're giving over $120 million in ad credits to help health ministries, NGOs and UN agencies reach billions 
of people around the world with COVID-19 vaccine and preventive health information. 

* In the US, we're partnering with the Johns Hopkins Bloomberg School of Public Health to reach Native 
American communities, Black communities and Latinx communities, among others, with science and 
evidence-based content that addresses the questions and concerns these communities have. 

e¢ We're also working with AARP to reach Americans over 56 with educational content about COVID-19 
vaccines, including Spanish-language ccntent designed to reach Latinx and Hispanic communities. 


Combating Vaccine Misinformation 
e We are expanding our efforts to remove false claims on Facebook and Instagram about COVID-19, 
COVID-1!9 vaccines and vaccines in general during the pandemic. Since December, we’ve reinoved false 
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© Today. following consultations with leading health organizations, including the World Health Organization 
(WHO), we are expanding the list of false claims we will remove to include additional debunked claims 

¢ Groups, Pages and accounts on Facebook and Instagram that repeatedly share these debunked claims may 
be removed altogether. We are also requiring some admins for groups with admins or members who have 
violated our COVID-19 policies to temporarily approve all posts within their group. 

® When people search for vaccine or COVID-19 related content on Facebook, we promote relevant. 
authoritative results and provide third-party resources to connect people to expert information about 
vaccines. On Instagram, tn addition to surfacing authoritative results in Search, in the coming weeks we're 
making it harder to find accounts in search that discourage people from getting vaccinated. 


Providing Data to Inform Effective Vaccine Delivery 
¢ Last year, we began collaborating with Camegie Mellon University Delphi Research Group and the 
University of Maryland on COVID-19 surveys about symptoms people are experiencing, mask wearing 
behaviors and access to care. With over 50 million responses to date, the survey program is one of the 
largest ever conducted and has helped health researchers better monitor and forecast the spread of 
COVID-19. 
¢ To help guide the effective delivery of COVID-19 vaccines, the survey data will provide a better 
of the survey will also allow for faster updates on changes in trends, such as whether vaccine intent Is going 
up or down in California in @ given week and better insights on how vaccine intent varies at a local level. 
vaccine attitudes at a county level vlobally. 
These new policies and programs will help us continue to take aggressive action against misinformation about 
COVID-19 and vaccines and help people find where and when they can get vaccinated. You can read more about 
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Exhibit 4 


Email correspondence between 
Facebook and the White House 
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From: </O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)}/CN=RECIPIENTS 
/CN=DF1BAA17A67B4CA4BA85441653B797B2> 

To: Flaherty, Robert EOP/WHO; Rowe, Courtney M. EOP/WHO; Humphrey, Clarke EOP/WHO 

Cc: 

Sent: 2/11/2021 2:17:22 AM 

Subject: Re: COVID-19 Outreach to communities worldwide 

Hi Rob, 


Quickly fellowmg up to see when you would like to have a meeting arranged to speak to our misinformation team 
reps about the latest updates. They also have 2 more detailed misinformation analysis prepared based on the 
discussions/questions from the previous meetings during the transition time period 


Best, 


Get Outlook for 10S 


From: 2 com> 
Sent: Tuesday, February 9, 2021 5:57:52 PM 


T, EOP/WHO > 209 00 Rowe, Courtney M. EOPWHO 
who.eop.gov>; Humphrey, Clarke EOP/WHO who.eop.gov> 


a 


Subject: Re: COVID-19 Outreach to communities worldwide 


Good evening Rob, 


We have provided responses to your initial questions with input from the various teams below . We are happy to 
discuss these and additional questions as per your recent note. Do let us know a few windows that work for you. 


Can you share more about your framew ork here? May, of course, is very different than “will.” Is there a 
strike policy, ala Youtube? Does the severity of the claims matter? 


We dort disclose the details of our thresholds publicly due to concerns about users gaming the system to avoid 
enforcement, however we do notify Groups, Pages, and Advertisers when we've removed content that violates our 
Community Standards. We start placing restrictions on accounts, Pages, and Groups for multiple violations, 
including restrictions on their ability to share content for increasing periods of time and limitations on their ability to 
reach their audience. If violations continue, we will suspend the entire Page, Group, or account. Additionally, when 
we review Pages and Groups we look at how tney describe themselves and may restrict or remove them if the title 
or description violate our policies. 


And as far as your removal of claims, do you have data on the actual number of claims-related posts you’ve 
removed? Do you have a sense of how many are being flagged versus how many are being removed? Are 
there actions (downranking, etc) that sit before removal? 


It is a bit too early to be sure- We will begin enforcing this policy immediately, with a particular focus on 
Pages, Groups ard accounts that violate these rules, and we'll continue to expand our enforcement over the 
coming weeks. There is a range of content that can violate these policies, and it will take some time to 

train the reviewers and systems on enforcement. 
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How are you handling things that are dubious, but not provably false? 


In consultation with leading health organizations, we continuously expand the list of false claims that we remove 
about COVID-19 and vaccines during the pandemic. We remove claims public health authorities tell us have been debunked 
or are unsupported by evidence. 


Content which does not qualify for removal may be eligible to be fact-checked by our network of over 80 
fact-checking organizations. When one of our independent fact-checking partners debunk a post, we reduce its 
distribution and add strong warning labels with more context, so fewer people see the post. We do not remove the 
content, but are focusing on improvement effo-ts that will help us to better adcress content that contributes to 
unfounded hesitancy towards the COV!ID-19 vaccine. 

For example, we're working to proactively prevent posts discouraging vaccines from going viral on our platforms; 
address content that experts believe dissuades people from getting the vaccine, but does not violate our 
misinformation policies, through the use of infarmation labels: and prevent recommendations for Groups, Pages, 
and Instagram accounts that repeatedly push content discouraging vaccines. 


-On Behalf of the Facebook team 
FACEBOOK 


U.S. Public Policy 
Facebook 


From: "Flaherty, Robert EOPAWHO" < |B Owho. cop. gov> 
Date: Tuesday, February 9, 2027 at 4:59 PM 

fb.com>, "Rowe, Courtney M. EOP/WHO" 
who.eop.gov>, "Humphrey, Clarke EOP/WHO" 


Subject: RE: COVID-19 Outreach to communities worldwide 


All, especially given the Journals reporting on your internal work on political violence spurred by Facebook groups, 
| am also curious about the new rules as part of the “overhaul.” | am seeing that you will no longer promote civic 
and health related groups, but | am wondering if the reforms here extend further? Are there other growth vectors 
you are controlling for? 


Happy to put time on the calendar to discuss further. 


From: Flaherty, Robert EOP/WHO 
Sent: Monday, February 8, 2021 1:37 PM 


To: fb.com>; Rowe, Courtney M. EOP/WHO <2 0. .20p-gov>: 


Humphrey, Clarke EOP/WHO < who.eop.gov> 


Ce: fb.com>; fb.com>; i 


@fb.com> 
Subject: RE: COVID-19 Outreach to communties worldwide 


GT harks. 
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This line, of course, stands out: 
that repeatedly share these debunked claims may be removed altogether. 


Can you share more about your framework here? May, of course, is very different than “will.” Is there a strike 
policy, ala Youtube? Does the severity of the claims matter? 


And as far as your removal of claims, do you have data on the actual number of claims-related posts you've 
removed? Do you have a sense of how many are being flagged versus how many are being removed? Are there 
actions (downranking, etc) that sit before removal? How are you handling things that are dubious, but not provably 
false? 


Thanks 


From: i ©f.com> 
Sent: Monday, February 8, 2021 1:18 PM 


To: Rowe, Courtney M. EOP/WHO <M @who.eop.gov>; Flaherty, Robert EOPAWHO 
who.eop.gov>; Humphrey, Clarke EOP/WHO < who.eop.gov> 
3 or I .co:7 


Subject: [EXTERNAL] COVID-19 Outreach to communities worldwide 


Good afternoon Courtney, Rob, and Clarke, 


We wanted to make sure you saw our announcements today about running the largest worldwide campaign to 
promote authoritative COVID-19 vaccine information and expanding our efforts to remove false claims on 
Facebook and Instagram about COVID-19, COV|D-19 vaccines and vaccines in general during the pandemic. 
More details are in our Newsroom: authoritative COVID-19 vaccine information and COVID-19 and vaccine 
misinformation. 


Helping People Find Where and When They Can Get Vaccinated 
¢ Starting this week, we'll feature links in the COVID-19 Information Center to local ministry of health websites 
to help people understand whether they're elicible to get vaccinated and how to do so. 
¢ And inthe coming weeks, as more information becomes available, we'll continue to improve this feature, 
making it easier for people to see where and when they can get vaccinated in just a few taps. 


Sharing Credible Information About COVID-19 Vaccines 

e We're working with health organizations and community leaders to run campaigns on our platform promoting 
accurate information about COVID-19 vaccines and encouraging people to get vaccinated. 

e We're giving over $120 million in ad credits to help health ministries, NGOs and UN agercies reach billions 
of people around the world with COVID-19 vaccine and preventive health information. 

e In the US, we're partnering with the Johns Hopkins Bloomberg School of Public Health to reach Native 
American communities, Black communities and Latinx communities, among others, with science and 
evidence-based content that addresses the questions and concerns these communities have. 

e We're also working with AARP to reach Americans over 50 with educational content about COVID-19 
vaccines, including Spanish-language content designed to reach Latinx and Hispanic communities. 


Combating Vaccine Misinformation 
e We are expanding our efforts to remove false claims on Facebook and Instagram about COVID-19, 
COVID-19 vaccines and vaccines in general during the pandemic. Since December, we've removed false 
claims about COVID-19 vaccines that have been debunked by public health experts. 
e Today, following consultations with leading health organizations, including the World Health Organization 
(WHO}, we are expanding the list of false claims we will remove to include additional debunked claims about 
the coronavirus and vaccines. We already prohibit these claims in ads. 
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* Groups, Pages and accounts on Facebook and Instagram that repeatedly share these debunked claims may 
be removed altogether. We are also requiring some admins for groups with admins or members who have 
violated our COVID-19 policies to temporarily approve all posts within their group. 

e When people search for vaccine or COVID-19 related content on Facebook, we promote relevant, 
authoritative results and provide third-party resources to connect people to expert information about 
vaccines. On Instagram, in addition to surfacing authoritative results in Search, in ihe coming weeks we're 
making it harder to find accounts in search that discourage people from getting vaccinated. 

¢ As we noted last month in response to guidance from the Oversight Board, we are committed to providing 
more transparency around these policies. You can read the detailed updates in Facebook's Community 
Standards and in our Help Center. 


Providing Data to Inform Effective Vaccine Delivery 

e Last year, we began collaborating with Carnegie Mellon University Delphi Research Group and the 
University of Maryland on COVID-19 surveys about symptoms people are experiencing, mask wearing 
behaviors and access to care. With over 50 million responses to date, the survey program is one of the 
largest ever conducted and has helped fealth researchers better monitor and forecast the spread of 
COVID-19. 
To help guide the effective delivery of COVID-19 vaccines, the survey data will provide a better 
understanding of trends in vaccine intent across sociodemographics, race, geography and more. The scale 
of the survey will also allow for faster updates on changes in trends, such as whether vaccine intent is going 
up or down in California in a given week and better insights on how vaccine intent varies at a local level. We'll 
share these new insights including vaccine attitudes at_a county level in the US as well as globally. 


These new policies and programs will help us continue to take aggressive action against misinformation about 
COVID-1¢ and vaccines and help people find where and when they can get vaccinated. You can read more about 
now we're supporting COVID-19 relief efforts and keeping people informed at our COVID-19 action page. 


-On Behalf of the Facebook team 


FACEBOOK 


U.S. Public Pelicy 
Facebook 
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Exhibit 5 


Email correspondence between 
Facebook and the White House 
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From: MT <0 = THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN= oii 3 F > 


To: Qureshi, Hoor EOP/WHO 

Sent: 3/1/2021 11:45:07 AM 

Subject: Re: Facebook proposal to help mitigate vaccination hesitancy 
Will do! 


From: Qureshi, Hoor EOP/WHO <0. cop. gov> 

Date: Monday, March 1, 2021 at 1:40 PM 

To: I < EEO > com> 

Subject: RE: Facebook proposal to help mitigate vaccination hesitancy 


Ok perfect! Let me know if you have any issues, and I'll add them on the invite from my end. 


From: < 2 com> 

Sent: Monday, March 7, 2021 1:38 PM 

To: Qureshi, Hoor EOP/WHO <i @who.eop.gov> 

Subject: [EXTERNAL] Re: Facebook proposal to help mitigate vaccination hesitancy 

OH great—l will just forward. Some shifting may happen to the last minute and | don’t want to have to bug youl 


Thank youl 


From: Qureshi, Hoor EOP/WHO <{owho.eop. gov> 


Date: Monday, March 1, 2021 at 1:37 PM 
[oT IC com> 


Subject: RE: Facebook proposal to help mitigate vaccination hesitancy 
Hello! 


So sorry | missed this. Do you want to just pass along the emails and | can get them added to the invite? Or you 
can forward the information! Whatever is easier for you works for me. 


Best, 
Heoor 


From: - fb.com> 


Sent: Monday, March 1, 2021 1:32 PM 
To: Qureshi, Hoor EOP/WHO Po '0-200 cov 
Subject: [EXTERNAL] Re: Facebook proposal to help mitigate vaccination hesitancy 


Bumping this! 
Thank youl 


From: i <P A com> 

Date: Monday, March 1, 2021 at 11:29 AM 

To: Qureshi, Hoor EOP/WHO < who.eop.gov> 

Subject: Re’ Facebook proposal to help mitigate vaccination hesitancy 


Happy Monday, Hoor! 
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| have a few changes to who from FB will be joining our meeting this afternoon. 
Would you like a full list, or is it ok for me to pass on the zoom credertials to them? 


Happy do what works best for youl! 


From 2 <-> 


Date: Monday, February 22, 2021 at 5:12PM 
To: Qureshi, Hoor EOQP/WHO < 
Clarke EOP/WHO 


Mwho.eop.gov> 
who.eop.gov>, Flaherty, Robert EOP/WHO 


HHS/ASPA) 
@hhs.gov> 
Subject: Re: Facebook proposal to help mitigate vaccination hesitancy 


Thank you! 


From: Qureshi, Hoor EOP/WHO < 
Date: Monday, February 22, 2021 at 4:56 PM 

To: @fb.com> 

Cc: Humphrey, Clarke EOP/WHO <{ Qwho.eop.gov>, Flaherty, Robert EOP/WHO 


Wwho.eop.gov> 


HHS/ASPA) 
@hhs.gov> 
Subject: RE: Facebook proposal to help mitigate vaccination hesitancy 


Perfect, just sent out the invite! 


From: fb.com> 
Sent: Monday, February 22, 2021 4:52 PM 
To: Qureshi, Hoor EOP/WHO <= 


@who.eop.gov> 
who.eop.gov>; Flaherty, Robert EOP/WHO 


who.eop.gov>; @fb.com>; Rowe, Courtney M. EOP/VVWHO 
; .gov>: fb.com>; ifb.com>: 
; ; HHS/ASPA) < hhs.gov> 


ubject: e€: Facebook proposal to help mitigate vaccination hesitancy 


Great, let's go ahead and lock that in. 
Looking forward to it! 


From: Qureshi, Hoor EOP/WHO TR ">. <0. s0~ 
Date: Monday, February 22, 2021 at 4: 


AE 3 com> 


who.eop.gov>, Flaherty, Robert EOP/WHO 


>, C y M. EOP/WHO 
2 HHS/ASPA) 
@hhs.gov> 


Subject: RE: Facebook proposal to help mitigate vaccination hesitancy 
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‘ 
Team ODS coud make any of these times work, but noting that March 1 at 39m would probably work best! 


Thanks, 
Hoor 


From @fbh.com> 
Sent: Monday, February 22, 2021 1:33 PM 

To: Qureshi, Hoor EOP/WHO 
Cc: Humphrey, Clarke EOP/AWHO 
whio.eop.gov>; 


who.eop.gov> 

who.eop.gov>; Flaherty, Robert EOP/WHO 
fb.com>; Rowe, Courtney M. EOP/WHO 

< Dwho.eop.gov>, <Dilanrice@fb.com>; fb.com>; 

fb.com> 


ubject: e: Facebook proposal to help mitigate vaccination hesitancy 


Hi All, 


Following up on schedules for the Misinfo/Disinfo meeting. 
Here are our teams’ options 


Friday 26) 2pm ET 
Thursday 25° 330pm ET 
Monday 15* 3pm ET 


Hopefuly one of those works for folks! 


From: Qureshi, Hoor EOP/WHO < 


Date: Sunday, February 21, 2021 at 5:26 PM 
1: 


Cc: Humphrey, Clarke EOP/WHO 


Mwho.eop.gov> 


who.eop.gov>, Flaherty, Robert EOP/WHO 
fb.com>, Rowe, Courtney M. EOP/WHO 


fb.com>, ( HHS/ASPA) 
@hhs.gov> 


Subject: RE: Facebook proposal to help mitigate vaccination hesitancy 


Great, just send around an invite for Tuesday! “ll keep an eye out to schedule another conversation for later this 
week. 


Best, 
Hoor 


From: Si © t.com> 


Sent: Sunday, February 21, 20214:36 PM 
To: Quresti, Hoor EOP/WHO < 


who.eop.gov> 

who.eop.gov>; Flaherty, Robert EOP/WHO 
fb.com>; Rowe, Courtney M. EOP/WHO 
fb.com>: @fb.com>; 
HHS/ASPA) < 
Subject: [EXTERNAL] Re: Facebook proposal to help mitigate vaccination hesitancy 


hhs.gov> 


That's great — let’s go ahead and lock in Tuesday — and just to make sure we aren't crossing conversations with 
similar teams — Tuesday we'll be talking Frames and why don't we try for a misinfo/disinfo later in the week. 


121 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0003899 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


I'll get availability from our misinfo / disinfo folks tomorrow and loop back. 


facebook, inc. | politics & government 


On Feb 21, 2021, at 3:34 PM, Qureshi, Hoor EOPAVHO <9 ino. .cop.gov> wrote: 


Hello! Tuesday at 12:30pm would be better for Rob’s schedule, and Wednesday is also mostly open as of now if 
that works better for folks! 


fb.com>; Flaherty, Robert EOP/WHO < who.eop.gov>; 
m>; Rowe, Courtney M. EOP/VWWHO @who.eop.gov>; Qureshi, 
Hoor EOP/WHO who.eop.gov> 
fo.com>; 


Ce: : 
ae o> (HHS/ASPA) < hhs.gov> 
Supject: RE: Facebook proposal to help mitigate vaccination hesitancy 


Looping @Qureshi, Hoor EOP/WWHO <i here — Hoor does one of these times 


work for Rob on Monday or Tuesday? 


From: @fb.com> 
Sent: Friday, February 19, 2021 3:29 PM 
To: Flaherty, Robert EOPAWHO 
: Who.eop.gov>; 


who.eop.gov>; Humphrey, Clarke EOP/WHO 
fb.com>; Rowe, Courtney M. EOPAWHO 


fo.con>; 
hhs.gov> 
Subject: [EXTERNAL] Re: Facebook proposa) to help mitigate vaccination hesitancy 


Great! 
Our team could do the following—if we look into Wednesday we may have some more options, but let's start with 
these: 


Monday 12-1230pm 
Tuesday 1230-1ipm 


From: Flaherty, Robert EOP/WHO 
Date: Friday, February 19, 2021 at 2:07 PM 
To: Humphrey, Clarke EOP/WHO < who.eop.gov>, 
fo.com>, Rowe, Courtney M. EOP/WHO 


who.eop.gov> 


fb.com>, 
0.€0p.gov> 


fb.com-=, HHS'ASPA) = 
Subject: RE: Facebook proposal to help mitigate vaccination hesitancy 
Adding Bi recre, too. 


hhs.gov> 
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Agree we should chat about this and what other initiatives you guys are cocking on, as well as a convo on mis and 
dis. 


Looking forward. 


From: Humphrey, Clarke EOP/AVHO 
Sent: Friday, February 19,2021 2:03 PM 
To: fb.com>; m>: Rowe, Courtney M. EOPAWVKO 
o.eop.gov>; Flahert who.eop.gov> 


Subject: RE: Facebook proposal to help mitigete vaccination hesitancy 


Thanks, = We'd love to chat more about this. Do you have some time blocks on Monday or Tuesday that 
might work and | can try to get something scheduled? 


Sent: Friday, Februa 720 PM 


To: fb.com>; Rowe, Courtney M. EOP/WHO <I @ who .cop.gov>; 
Flaherty, Robert EOP/WHO EEE 0 wix0.c0p.gov>: Humphrey, Clarke EOP/WHO 
< who. eop.gov> 


or © f>.con>; 


Subject: [EXTERNAL] Re: Facebook proposal to help mitigate vaccination hesitancy 


Hi All— 


Following up here — the UK’s NHS has two Profile Frames that went live today<% 3ehttps:/% 3ewww.gov. uk 
/government/news/new-campaigr+to-support-vaccine-roll-out-backed-by-social-media-companies-and-british- 
institutions%3c%3c>, which look like this (mocked up on my testing profile below). They’re quite a powerful tool for 
showing solidarity / involvement — would be great to talk early next week to discuss using it for US vaccine 
campaigns. 


(Graphical user interface Description automatically generated] 


facebook, inc. | politics & government 
ror IR "© com> 
Date: Thursday, Februery 16, 2021 at 2:02 PM 


To: Rowe, Courtney M. EOP/WHO <I who.cop.goy> obert EOP/WHO 
who.eop.gov>, Humphrey, Clarke EOPAVHO < Wi0.e0p.gov> 


< Dfb.com>, dfb.com> 
Subject: Facebook proposal to help mitigate vaccination hesitancy 
Good afternoon Courtney, Rob, and Clarke, 


| hope everyone is doing well and taking care amidst this wintry weather. I’m reaching out today with an immediate 
idea from the team that we think will significantly help with outreachy/hard to reach communities to help mitigate 
vaccination hesitancy. For our part, we have some of our product reps available to speak more deeply to the 
profile frames proposal below at your soonest availability. 


| also want to circle back on the misinfo meeting we are looking forward to having. It would include some new 
insights we have and a deeper discussion of wnat more we can do. We think best to have the proper reps to 
include yourself, HHS and CDC. Can we look to you to help surface dates that this can take place soon? We also 
spoke to | HHS about the frame proposal below and they are also looking forward to a deeper discussion 
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on that and a discussion on misinformation. We are not sure the appropriate rep at CDC that you would suggest 
for the misinformation meeting, but we look forward to meeting with the team you bring together. 


Profile Frames: Some governments and NGO partners worldwide are currently executing campaigns on Facebook 
encouraging people to share that they got vaccinated (or plan to} in order to normalize getting the vaccine. For 
example, some partners plan to execute a major campaign starting next week centered around profile frames and 
similar assets on Facebook and Instagram (e.g. "I'm COVID vaccinated”) that people can opt-into. This campaign 
can also activate a broad set of trusted Influencers and public figures to help. These partners asked us to partner 
with them in promoting this campaign, which we are fully supporting. 


As such, we believe that a similar effort could make a significant difference around vaccination intent in the US and 
we would [ike to explore supporting such a campaign here. Given the scale of our platforms and daily reach, a 
well-executed campaign could be seen by millions of people in the United States alone, and potentially help change 
attitudes toward vaccination. 


Attached are some initial design explorations that we are iterating on. These are not final design templates {more 
for illustrative purposes). We can provide the final templates to you by Friday. 


We're also happy to further discuss how we believe this can help gain momentum around vaccine uptake and 
confidence, and explore how we can support promotional efforts to drive adoption of these frames. Once you're 
comfortable and in a position to move forward, we would Just need the digital teams to upload the frames through 
the official Facebook accounts you'd like to use; we're also happy to help the teams do this. 

We are excited to explore partnering with the US government on this and make a significant difference around 
vaccination intent domestically. We can move as fast as needed to activate this campaign. 


Intu30T ZXDESOAAAAABJRUSErkJggg==] 


-On Behalf of the Facebook team 


U.S. Public Policy 
Facebook<% 3ehttps:/about. fb.com/%3c> 


ae 
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Exhibit 6 


Facebook’s Call Notes with the White 
House and HHS/CDC 
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3/26 White House Call Notes 


Attendees: Roby Flaherty 


netendecs (5) 


° a — wanted to make sure we had time, we have a few things coming to you. We 
have an update to the symptom survey in a week. We could set up time to walk 
through the one you have, the new info. It’s a different look, but useful, want to talk 
through 

e Rob —useful, especially from comms folks 

e ai — will have more detail on demographics, should be improved. We also have data 
stuff from last week, want to center our work on universe of co t. Nick told Andy 
that it will take some time to build, will have that ASAP. Today,wanted you to meet 

our Product lead across all COVID defensive worka When Nick was talking to 

Andy about areas where we were unable to provide an should be able to 

provide more information. She’ll do an overview. We’ll make sure to follow up on any 

questions. 

e eas — Hopeful for open confirmation, my job is focus on responding to immediate 
issues. | report to I’m jumping in midstream, may have some questions, | want to 
understand where we’ve been missing the mark, addressing gaps, see areas where we 
may not have direct answers but cowd look at proxies, other solutions. Want to 
understand problems, priorities going@ogWard. 

e Rob-sounds great. Maybe helpful to hear where we’re coming from — we’re 
concerned about FB impact on vaccine hesitancy, we see so often in data that people 
who are vaccine hesitant see on FB. Our theory is that content is harder to remove is 


doing the most cig Spi are setting on the fence. We understand taking down 


that content is not olution, for us, we want to understand if our theory is right, 
where you see whatsedfiving vaccine hesitancy, what you are doingm how we can plug 
in and get you things. If you find things that are working, want to hear that. That’s 
what we care about. We’re not trying to screw you guys, we want to solve this 
problem. In 3 months, when there’s a demand problem, we'll be in the barrel 
e a — similar strategies — 
o Inform 
o Remove what’s actually harmful 
o Reduce where there is hesitancy 
° aes —| know you want numbers, | don’t have numbers yet on how interventions are 
working on, looking at proxies. Today — can sepak to levers, where are we reducing 
content, introducing reshare friction, have some things we can dig into. Nick 
mentioned we’re looking at viral content, that’s a metric we want to get you, but 
centralizing work — also looking at large entities, big groups, pages, big IG accounts. 
Last one is comments. One thing that’s difficult — good post, bad comments, we see 
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that quite often. We see authoritative info from WHO having a lot of hesitancy 
comments. Top skepticism comments on those posts, don’t 

e Rob-so you're focused on virality, big entities like pages/groups, less on 
comments/posts between friends 

e aa — for the most part, right — the way we think about — head problem — where do 
we see hot spots — minority individuals/entities producing content that then gets 
resdistributed. From prioritization perspective, that’s how we know content will be 
redistributed/upranked/reshared. This is for hesitancy (not misinfo, which gets 
different treatment). We want to know overall hesitancy content, what are 
interventions. Detection methodology is dependent on topical conversations — that will 
take weeks, if not months. So in the interim, focused on the hot spots. Does that make 
sense? 

e Rob-yes, makes sense. Do you have a tangible example? Don seen is helpful. 

e = — | asked the teams this morning — overall viral pieces get — anecdotally, 
they’ve shared 

o Topics trending towards uncertainty — FDA app uthorization — general 
confusion about that 

o Another one — concerns about vaccinated people shedding the virus to non- 
vaccinated people nearby — indirect 

o Have seen a lot of groups sharing individual stories about side effects or death 
after vaccination 

o. If we’re taking authoritative ipfogrmation — we could detect outright 
discouragement based on ar link, but it’s harder to detect skeptical 
comments like “Oh, isn’t that interesting.” — we are working to be able to detect 
that, but we can’t yet 

e Rob-—that makes sense. Fascinating. I’m curious — NY Post churning out articles every 
day about people dying. What is supposed to happen to that from Policy perspective. 
Does that article ge Gi uction, labels? 

e iis — Let’s go ba@ketO remove (outright misinfo), reduce (not benign, more 
sensationalism, eg claim vaccines create miscarriages, indirect discouragement), inform 
— levers are contingent on content type, who posted it. We look at removing from 
recommendations, explorer, we want to take all this content out of that. E.g. Health 
Groups are non-recommendable, want to get them out of areas where we recommend 
or amplification systems. What we’re prioritizing in feed — want to make sure that 
anything we suspect is hitting skepticism, harmful topically but we can’t remove, we 
reduce. | don’t have those numbers today. 

° [ieewes —a lot of things get viral copy-pasted. We have a concept of introducing an 
inform interstitial — if | go to reshare post like that, have an interstitial noting that a post 
has been rated false by 3PFC. We can also do fwd limits. These are are all methods 
we’ve used where there’s not super clear lines in the sand. That’s a suite of tools we’re 
trying to apply right now. 

e Rob-The question | have, if you’re applying these methodologies, where is it still 
breaking through? And to whom? If it’s still there, where is next whack a mole? 
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e aa — big whackamole is that this all depends on our ability to detect. We’re getting 
better at detecting things like the microchip thing and delete that. We’re getting better 
at detecting (human, natural language processing) discouragement. We find COVID 
posts, then we identify posts that are explicit discouragement, or this is bullying for 
choosing to get vaccinated. What’s hard right now, we haven’t completed full 
detection path. We need to close gaps, that’s what we’re doing. The comments thing 
isn’t solved, that’s the big thing keeping me up at night, that I’m most worried about 
from an implementation perspective. 

e Rob-so substantive problem is not that there are holes in the policy, it’s more that the 
detection of things that needs more work 

° lis — the hard part is that what could be applicable to policy is moving, the timeline 
takes some time. Things are evolving on a discussion basis. This also gets harder as 
events evolve. For example, recent charges in Italy against two tors and a nurse for 
administering Astra Zeneca vaccine. That creates a net new topic fof our systems to 
need to be able to identify and get to intervention. That’sqvhy inform — driving to 
authoritative sources, CIC — that’s why it’s so importan ay to resolve/educate 
individuals who aren’t adversarially minded — compared toyevery real world event. 
Trying to get to fastest real solution v managing symptoms of having right information. 
| want to get a few minutes at the end to talk about next touch point. A lot of what | 
just said — there are also individuals that are adversarial, very good at following rules, 
know where the lines are, driving things off platform. 

e Rob-—Ican go over 12:30 if you can. question on inform — intellectually my bias is 
to kick people off. Inform, intellectually, Maybe path of most impact. How are you 
measuring impact when you do inform? Is there secret sauce targeting that we can 
use? Stanford has suggested building targeting tools of people that engage with antivax 


content. 
e iy — This is where it gets into Offense side, this is what Ji was talking about. 
How do we measu ess — are we getting people vaccinated. We have metrics 


around how many p e we’re informing, how quickly, how thorough. Are we 
identifying right content. Best directional metric is that symptom survey. We don’t 
have a strong causative way of saying because integrity did X, we now see preventing 
growth — we don’t see that. That’s why we end up in education. If we’re getting at do 
people have more information, are they better educated, that symptom survey is best 
we have right now. 

e Rob -—that survey, you are doing treatment survey 

e fo — real measure of success — did people go to center, did they read content, did 
that change perspective — broader integrity — unless someone tells us, hard to measure 
if we’re changing hearts and minds, unless we do survey 

e Rob -what are most successful inform interventions? 

e =a — only a few that are very topical based right now, don’t have metrics now. 
People have concers about methodology or safety on vaccines. We’re in a test phase 
on broad COVID inform treatment that drives to FB/IG. There’s a post, we put inform 
treatment driving directly to CIC. Not even about violating content — just broad swath. 
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That’s the next big push of what we think might be a good inform treatment. In an 
ideal state, we want to get as precise as possible. The north star would be addressing 
each topic, but that degree of specificity might not be something we can ever get to. So 
trying to go broad and wide, with a big focus on the US. Trying to push out much more 
information given trends we’re seeing. 

e Rob-our public campaign, largely grants, fed govt not most trustworthy actor on 
vaccines — how can community organizations plug into FB in a way that will be 
maximally effective. Is there tooling that’s coming online? 

e in woh —1’d love to continue this conversation — I’m not a lawyer, know we have to be 
sensitive to personal information, targeting. In terms of targeting, one of the 
interesting trends we’ve seen in my own experience — local FB Groups — city, council, 
regional groups giving info about when new appts are available. I’m personally seeing 
local group community organizing. Might be an interesting thin look at — how are 
communities having those conversations — something to explore further. 

e Rob- to i point, that’s the next question — how can we plug In, how can we help. 
W e’re going to be a clearinghouse for ad campaigns, we bring to bear. 

° a — Action items: 

© Chat more about how to do more targeted/communication to vulnerable 
communities 
o Symptom survey 


° — we'll put a briefing on with Curtiss, our research director. 
e — we owe you a WA follow 
e — we'll send that over — we'll ta ur queues — weekly, biweekly checkin makes 


sense, if you want to communicate on the fly with me and 
e Rob - probably both — let’s put check in on calendar 
e ae — ok great, we’ll put on the calendar 


O 


we’re open 
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4-5 Notes on Call with White House re Symptom Survey 


WH attendees: Rob Flaherty, Courtney Rowe, Clark 


e eam Want to introduce [iii he leads our work on the COVID survey that we’re 
sending regularly to you. Want to walk through how we use it, how we approach it, 
how we think it will be useful in the work you’re doing to identify pockets of the country 
where vaccine hesitancy is more of a problem. faa will give an update at the end. 
Will turn it over to let us know if you have questions. 

e ea Hi Rob and Courtney, nice to meet you. Please interrupt with any questions, see 
this as a conversation. | lead a special methodology team — De aphy and Survey 
Science. I’m a sociologist by training. The survey that we’re runing With CMU and 
UMD -— using FB’s superpower in combination with superp@wer of public health 
community to understand at a granular level issues. W public health experts to 
help with what goes into survey, we aren’t public health eXperts. In the US alone, we 
collect about 40,000 responses per day. Next largest — 75,000 responses every two 
weeks — the Household Pulse Data. Temporal and granularity make valuable 
instrument. We don’t have access to individual responses, but we use data internally to 
help inform messaging campaigns, understand in the US, the world, where different 
messages might resonate. | can goi igh level insights by race/ethnicity/age etc., 
real time info on preventative health ior. But want to address what you want to 
hear about. High level things most pertinent: 

o We’ve all heard in the media and other data sources about disparities among 
people of color versus whites with respect to hesitancy. This survey points out 
that vaccine accepting black and LatinX adults are less likely to have attempted 
to make an a @ hes In LatinX community, highest gap in MD, NY, VA. MD 
— disparity between LatinX and white adults is largest — interesting because MD 
is one of the least hesitant states. State like NM, much older Latino population, 
actual parity between white population and Latino population there. 

o States where most hesitant — MI, Indiana, Ohio — reasons people are giving — side 
effects, waiting to see what happens, lack of trust. In other states, a lot of 
diversity across the US. Nice thing about this data is you can dive in at a county 
level to see how the numbers are changing over time so you can think about 
potential interventions. 

o Another highlight — looking at real time preventative health behaviors. E.g., 
Texas with no mask mandate — we can look before and after lifting mask 
mandate on March 10. 3% decrease in people reporting wearing masks. We see 
heterogeneity across counties. Travis county kept mask mandate, saw very little 
change. Harris county, saw a 5-point change. We can understand 
microinterventions, how they are affecting behaviors. Can also look at interest 
in vaccine, what concerns people are having. 
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o This is just some of the ability that we have. The results are usually available 
about a day after collected. If we collect today, can see estimates tomorrow. 
That allows us to be able to understand the changes occurring as pandemic is 
unfolding. 

o Change instrument frequently, in 7 languages. 

o Would love to answer questions, what you’d like to see. 

e Pe Fa Rob, you heard from a that we’re using survey to get feedback and see in 
the real world how people are responding. View it as a valuable tool. Would love 
feedback on how could use it. We have a new version coming to you next week. 

) io Have collaborated with CDC, gotten a lot of good feedback, a lot of interest from 
academic community. Zeke Emmanuel just co-published an article looking at self- 
modulated behaviors in response to rising case rates. 

e Rob: In terms of the survey, when gleaning things from it, how ou compare 
population on FB against general population? 

e ites | About 93% of adults in the US use the internet, abaut 83-84% on FB. We have 
more data about people on FB than people on survey p -WPeople don’t join FB to 
take surveys, orthogonal w/r/t bias. Some slight skews, butwe think we do pretty well. 
The value of the data isn’t that there isn’t bias, it’s that the bias is consistent over time. 
If you want to understand over time across geographies, we can offer that better than 
anyone else. 

e Rob: First packet | got in mid-March, was results from February, was useful. I’m curious, 
what are messaging things that are mOst,useful. What are you finding that has worked? 

° f= We haven’t engaged with our interventions, we’re rolling that out, it’s early 
to say. 

° had You’ll recall, we’re doing a lot of broad inform, we felt we didn’t have the right 
targeting in place to go deep. One thing | want to make sure we’re not losing, any 
subtext — how do we enable you to find the communities that need the more targeted 
messaging? C) 

e Rob: we want to fin ere is the biggest problem, what has been materially useful. 

3 eal Survey itself can tell you the reasons that hesitant but persuadable are being 
influenced by norms and expectations of people around them in their lives. You can see 
at a geographic level the differences. But you can also see who they trust. Those also 
vary by geography and population. If you take that — can explore local messengers in 
one community, friends and family in another, more elite spokesperson is another. It 
can help you with the messaging, but you have to try it to see if works. 

e aa It’s hard for us to prove out that an informative piece of content changes hearts 
and minds outside of survey. Social norms, like profile frames, seeing friends and family 
and public figures, could help. 

e i 1 So when 28% people of NH saying they are waiting because other people need it 
more, then maybe you need to match message to not to wait. Almost like political 
microtargeting. 

e Rob: How do we make that operationally useful for us and track it? 
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® fae Because of privacy reasons, we work through academic partners. You could 
work through academic partners, or there is a public API. We can talk about the 
cadence you might want to receive the information. 

o For example, prime minister’s office in UK want to access data to build out a 
dashboard. 
o Wecan help get in format that’s the easiest way for you to consume. 

e Rob: Format like the document you sent, the high-level takeaways, that’s helpful. With 
API, might need i or HHS. | probably won’t be using the API. 

° a Would be great to follow up with 4 Love that broken down by region 
and demographics. But equally important, how do we work with you all to push back on 
it. If someone in rural Arkansas sees something on FB, it’s the truth. 

e a OK — so in terms of action items 


o Find ways to reduce delay 
o Maybe there is a future opportunity to bring in my er who is 
working on roll out of info on state sides 

e P| That would be great. But we want to underst to counter and correct 
myths. That piece of it is equally important. Seeing countésnarrative on FB will be much 
more effective. 

° aaa We will push to get more frequent versions of this, can also look for red alert, 
COVID survey concierge service, will look at what we can provide. ae want to see 
what survey can tell WH about where people are hesitant and how we get messages to 
them. Then also on FB to counter misinfo through labeling, pushing authoritative info to 
people. That’s something we’re maki riority. 

Super helpful to get this information, this is what we need. What we need is 

help pushing back on the myths. 

° it Doesn’t just help us understand how and where to intervene, but it also tells us 
if the interventions age.working. We can see overtime if hesitancy is decreasing where 

e Rob: Rather than nO individual narratives/demographics, know you’ve said that 
broad access is more of philosophical approach. 

e apa Don’t think that targeting is the wrong way to do it, it’s a sequencing thing. 
Remove harm, reduce hesitant, inform good. In an ideal state, we inform, but we can 
also identify and reduce hesitant. But since the detection still isn’t quite there for 
hesitancy, we are starting with inform. Maturity of our detection is the core of 
challenge for identifying and removing and also means harder to do more targeted 
interventions. 

e Rob: Question | have — if we focus on broad stuff next — if we are to take things from 
more targeted info, we run targeted ads and local media. You can look at what’s 
showing promise, what’s in the lab. 

° a Yes — right now, it’s all broad. Wondering if there is a way to combine vast 
majority of fastest groups about how to find appointments, discussing side effects. Do 
we leverage this kind of activity - we know from human patterns of behavior that 
people are trying to do X, can we build a better data set. 
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® ina That’s where a lot of our efforts are trying to go. We are looking at using CDC 
SVI to see if we’re having a more or less positive effects on those counties that are 
considered as vulnerable by CDC. Can we bring together behavioral aspects of what we 
see. Not building two different tools, building one, market the same one to different 
people. 


e as Can we bring next time, i This is at the heart of biggest opportunity 


to work together. 

e aaa Yes. 

e Rob: Is the problem that there isn’t a tool? Or the more someone uses FB, the more 
likely to be vaccine hesitant? 

e lane ae Don’t think we have data that suggests that. Literature on vaccine hesitancy — 
people bring hesitancy to the groups that they are in. They aren’t more hesitant as a 
result of social media campaigns. Do think that for some populatf@ns — not knowing 
how to get an appointment is actually a barrier. FB can help Acad need. For other 
populations, might have a more effective message. Vaccinehesitant, anti-vaxxers. We 
can address concerns of vaccine hesitant by understand cerns and address. 

e 4d Remove harm — about trying to actively do harm —that’s the vast minority but 
we want to remove. Hesitancy — want to keep getting as much information as | can to 
you. Vast majority of overall widely distributed content, authoritative and good — from 
CDC, etc. Hesitancy themes around side effects — is vaccine causing nose bleeds, 
enlarged lymph nodes. We still have a gap in understanding or managing expectations 
as to what experience could be like. her thing — lots of questions over finding 
appointment. Seeing a trend in mem satire making fun of individuals that don’t 
want to get vaccine. Political themes: video of Biden speaking, reactions. Still small 
group of adversarial people, large group who are hesitant and have concerns about side 
effects, finding appointments. 


e Rob: Are you able to provide resources? 
e eases, This is wy Ba inform — we tag anything with COVID-19 vaccine, it directs 


you to the COVID information center. Ideal state — | have a concern about a nosebleed, 
here’s a resource exactly about that. That from a technical perspective is really hard, 
which is why it’s broader. 

e fy tela It’s hard, and it may not be effective. Some research shows that allowing 
people to express experience and concerns might be a more effective path to having a 
conversation with them. Have to be careful in how we approach. 

e Rob: If people are having the conversation, is the presumption that we let people have 
it. Direct them to CDC. What then? 

e | | | think it’s an and. We all know people that have had the experience that think 
that FB is listening to them. The more general stuff, connection to CDC, pops up as very 
predictable, that’s fine, people don’t have issues with that. You have the opportunity to 
go back later, to surface information. At the immediate moment, have the big brother 
feel. We should pay attention to those conversations, make sure that people see 
information, even if it’s not right then. Have easy access to information. 
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° eal Also need to be honest here, deficit of trust in the government, deficit of trust 
in FB. Figuring out the right interventions that doesn’t reinforce some of those concerns 
around trust is really critical. Who are your trusted sources? Friends and family? 
Community figure? In areas where we or you aren’t the right voice, where we can find 
the right voice to address concerns> 

e Rob: how do we get that stuff to people? 

e ee there are a number of public health agencies we’re working with to do 
campaigns on FB — make use of ability to understand population and target messages 
appropriately. 

e rail Some of this is actually targeting. el and our ads team know more — a lot can 
be accomplished through targeting, third parties can definitely target — there will be 
demographic information that will be able to be used as well. 

e Rob: There are ways we can target around it. Since it’s a global demic, can we give 
agencies access to targeting parameters that they normally eae able to? 

... (missed 1 Q) 

e hee aoa Have other issues — for example, women of chi ing age worried about 
fertility. Can we adjust survey on a dime? Pregnancy is another one but I’m less worried 
about it. Conservative circles. Can we send stuff your way to look at? 

e ras Yes you can definitely share information with us, we can look at what we’re 
seeing, look at modifications to survey. CDC weighs in on questions. We do have 
questions, for example on pregnancy, we can look at whether it corroborates what 
you’re seeing. We have other thing job occupations that we’re looking at. 

° easy Want to be mindful of time, 

o In March took down 700,000 pieces of content globally, 150,000 in the US — this 
is a drop because we took down a lot and then were cleaning up 

o For full transparency and honesty, have moved out of a sprint that the teams 
have been in for the last 8 weeks, achieved goals, made progress — closed out 


foundationa rstanding work, early virality detection. Now focus for teams 
will be expedi execution. 

o Don’t want to seem like we’ve changed teams or priority, we’re just shifting 
focus. 


e Rob: Team that had been focused on vaccine hesitancy is moving to execution phase, 
figured out what you need to do 

e ae That’s right, but just within moving target, we’ve now identified the head of the 
problem, know what we’re doing, overall priority, teams, resources, hasn’t changed. 

° al We described this as a lockdown earlier. Wanted to hear from us, as things pop 
out of Facebook and into the Washington Post. Want to communicate clearly with you. 

e Rob: |! appreciate that, am not 100% understanding it but probably more me than you. 
What are the things that you found? 

e eel What | don’t want you to think is that we’ve declared victory and on vacation. 
What we found — had some improvements on misinfo accuracy, adjusting policies (e.g., 
removing 2 million pieces of content). Vaccine hesitancy — what we talked about last 
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time — it’s around topics — symptoms/appointments/memes/political themes, less about 
small group of adversaries. Now we’re focused on executing. 

e Rob: Execute is trying out new interventions? 

e aaa Great question — when | say execute — we’ve already been deploying 
interventions in a first version way. Now we’re expanding and improving the quality of 
those. 

3 ian What are you qualifying as misinformation versus politically charged? What 
does that universe of stuff look like overall? 

° [oaeasl The way that you describe it probably isn’t the way we think about it — misinfo v. 
politically charged. We have a policy definition of misinformation, then we have 
gradations of what we take down, versus reduce/inform. Might be easier to send some 
examples. 

e ae What are all the narratives that are out there? Woul interesting to see 
what’s misinformation versus something we'd flag. GS 

e ie That’s what i getting into with respect to thathemes. We’ll update you 
on the major themes that we’re seeing each week. Flat ‘ut, adversarial misinfo versus 
vaccine hesitancy content. 

e ea E.g., in last seven days, have seen claims about people playing God, etc. Is 
that misinformation? 

e a Maybe we can get some visual examples and send over. We'll pull a in 
around messaging channels. What am | missing J? 

Going to look at different way, hare survey information with Rob. Don’t want 

to just link API to you, want to be top e’ll take that back with =a team too. 

® io super helpful. 

e Rob: We can offline about specific format. We’re most interested in what’s keeping you 
up at night. 

e one We candot aise up to you quite frequently. Have a number of 

epidemiologists loo dt this internally and externally. 

| pinged the team about vaccine passports, can get you some examples. 

Religious thing — survey lets us know if concerns are religious. 

OK great. 

we'll meet again in a week? Can move to Mondays going forward. 
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4/14 Notes on Call with White House 


WH Attendees: Rob Flaherty, Clarke Humphrey, Andy Slavitt (joined at 30 min mark) 
FB Attendees: 


° | Idea today was to follow up based on meeting next week, we have ill on to 
talk to approach to getting authoritative information, i” has some info from survey, 
then will go through metrics. Also want to be very clear, know you are interested in 
empirical information regarding success of interventions. Obviously want to get you 
what’s helpful for you to do your job. 

° fa) | need to understand a little bit. How I’ve interpreted — you’re trying to find a 
causal link between someone not being exposed to vaccine hesi y content, and 
therefore went out and got a vaccine. From a behavioral perspective; we don’t see that. 
| want to make sure | understand what you’re looking for. We can pull click through 
rates, other numbers, but want to confirm. 

e Rob: Three things. We have to explain to President, Ron, ple, why there is misinfo 
on the internet, bigger problem than FB. Where issues are, what interventions are, how 
well they are working, for products, want to engage in things that you know to be 
effective. | don’t even care about specific methodology, you have better, richer data 
than we’ll ever have. What are the things driving hesitancy on your platform? What is 
it? How big is the problem? When y e intervening, how are you measuring success? 
| say these things because candidly thefe is not a lot of trust towards FB, | need to know 
what theory of the case is, where we can be most effective. | am, personally, nervous, 
reported that there are interventions that have been done in other contexts, like NEQ 
score, that have been pulled back. Want to make sure that you’re not finding things 


that are effective that you aren’t doing. 

° ese That’s nl terms of what we’re doing, we look at overall universe of 
content on FB, 1% is ed to vaccines. Some subset of that is hesitancy, some is 
misinfo. We know as of March, 900,000 pieces of content was misinfo, 150,000 was US. 
Outside of that, numbers are really hard for us because hard to identify definitive 
vaccine hesitancy content. Very explicit example — 40% of Marines not taking vaccine — 
that’s being presented as fact. People are questioning government. We’re struggling to 
identify within hesitancy content, the stuff that’s nefarious, the stuff that isn’t. We 
don’t know that if we removed everything, that it would alleviate external factors. 

e Rob: The 40% of Marines, vaccine passports, good examples. J&J. To me, the one view | 
have — total interactions on CrowdTangle — you have more data about who is seeing it, 
where’s it going. We don’t want to be in a position where we take down bad news. But 
if your goal as a company is to make it more likely that people will get the vaccine. 
People don’t see this in only one way. Is your presupposition to do these broad things 
without any sense. If you’re seeing something that is factual that is that kind of news, it 
will have a negative way in a way that it wouldn’t on other platforms. 
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° a: We are thinking about it the same way, we have the same challenge. We can’t 
ask news outlets to take down bad news. That’s why flooding with good information is 
so important. There are people that might see NYT, other trusted sources, have 
hesitancy. Then there’s the actual trusted communities — health 
agencies/government/experts/FB, family/friends/community. In my own life, hard to 
get my mom to take vaccine because she thinks she already had COVID and someone 
else should get it. That’s a weird example, removing the content prohibits discussion. 
How do we tone down the fervor? 

e Rob: Good question to be asking, you are a fervor machine. 

In terms of interventions, know that there are groups that are hot spots — 
mandatory post approvals — admins have to approve posts. If violating content 
approved, gives the group a strike. I’m uncovering new examples on comments — public 
figures on comments might be contributing more. Tomi Lahren Cije how she’s not 


getting the vaccine. Even with comment reduction, still struggling if We reduce 
comments from public figures, Tomi Lahren makes a post. 
@ Rob: On what basis are you finding that the public fevragghivent have impact? 

We don’t have that causal link — we’d have to do a’controlled study to expose 
people to misinformation or hesitancy content and study it. That’s unethical. We can’t 
measure that. |’d love to understand how you all are measuring that. 

e Rob: 1! don’t work at a company that profits on data. Hard for me to say. This is the 
whole problem. You guys are grading your own homework. 


° pol No, working with Carnegie M we aren’t seeing that. 
e Rob: As a general practice on Faceboo u don’t have a mechanism to test attitudinal 
impact? 


The impact assessment is the survey data. 

There’s a difference between being able to set up a causal type test on our 
proactive measures tostry to encourage vaccine uptake. The information we’re putting 
out — we can roll oso and have some sense on whether it’s having an impact on 
attitudinal measures aff we do some of those tests. On the side of stuff that’s misinfo, 
negative things propagating throughout the network. We don’t have as easy an 
opportunity way to set up tests to determine whether people were a priori hesitant or 
not. We can do that for proactive work, we do research before we throw it out. For 
example, things we are sharing with communities of color, making sure not culturally 
insensitive. Work with organizations on brand lift tests. It’s harder on the side of 
harmful content. 

e Rob: If you were to change the algorithm so that people were more likely to see NYT, 
WSJ, any authoritative news source over Daily Wire, Tomi Lahren, polarizing people. 
You wouldn’t have a mechanism to check the material impact? 

° Fae That would require people being comfortable self-reporting change in intent to 
FB. One of the reasons the symptom survey is set up separately with Carnegie Mellon, 
UMD, because we’re not under the impression that people 

e Rob: But you cannot link product to that. 
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® eee No, because the privacy rules in place, communicated to govt regulators, is that 
FB can’t have the identifiable data to tie it back. 

e Rob: If concern is measurable attitudinal effect, there’s nothing to test persuasive 
material on FB. Brand Lift surveys are what you sell people. 

e is We have the ability to do that for what FB or partners are communicating. 
Those are interventions that we can roll out, randomize through. When you’re talking 
about content issues, there isn’t independence of observation, material spreading 
through the network. SUTFA (?) violations there. Difficult to estimate causal effect. 
Ranking changes, given the small set of the population that we don’t know ahead of 
time, means there is a lot of dilution, takes a lot of time to pick up that effect. Attitudes 
don’t change immediately because of a ranking change. Have to allow time to take 
effect. If we made a change today, even with perfect experiment, would take a long 


time. And in pandemic time, we don’t have that time. 

e ie es That’s why from product perspective, it’s so important Ci at mechanisms — 
if we can’t remove it, at least we need to contain it. 

e 2 one piece of circumstantial evidence — we’re seé@i lines in vaccine 
hesitancy in the US similar to the decline that Census/Pulsa data is seeing. Trying to 
serve best data possible with others making decisions based on it. The problem is not 
stagnant as far as hesitancy among US FB population. It’s going down. Is it going down 
as fast as it could? | don’t have an answer. 

e Rob: Is it going down universally? 

e asi we have seen it go down am ubpopulations. Are seeing a 

e [Andy Slavitt is on the call at this poin :30 AM] 

e eee In Georgia, started talking about J&J halting earlier, we picked up an angle 
change there. Even across subpopulations, we aren’t seeing it. We aren’t measuring 
conservatives. We do look at counties and states, that are good proxies. We’ve been 
seeing things go dowpauntil recently. 

some of the beginning. A few questions on the pieces I’ve 

seen so far- is there ah¥spillover effect on attitudes from Pfizer or Moderna vaccines? 

What can you tell us about what people are saying about J&J? If people are spooked by 

the fact that there is a pause, | don’t consider that misinfo, disinfo, or problematic. The 

vaccines are working on 9 figures of Americans. What bothers us is when data is 
obscured by people that mispresent it, knowingly or unknowingly. If people have 
legitimate concerns and questions, we want to be able to answer them. People are 
within their rights to react to news. We want to know the most effective way to 
respond to that. More broadly, feels like we’re having a surprisingly tough time pinning 
down a plan of action of limiting the effects of people spreading misinfo on FB or WA. 

Question | asked 6 or 8 weeks ago — do we have or are we measuring the top, most 

shared negative sentiments? Are we measuring those over time? Are we taking the 

time to measure the impact of them? We’ve heard lots of conversation about other 
initiatives, a little bit of we can’t do this, we can’t do that. | just want to make sure that 
when we’re frustrated, we’re frustrated because we can’t seem to get a straight answer 
to what feels like a very simple question. 
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e ai Andy, nice to meet you, I’m the product lead. Going to try and work through 
your questions. eae! could you speak to J&J effects? | don’t know that we have 
spillover measurements on Moderna and Pfizer? 

e Andy: Perfectly reasonable you wouldn’t have, if you could monitor over next few days, 
would be great. 

e [Earl On Moderna and Pfizer, based on guidance from Rob, trying to promote as 
much good as we can in CIC. [eens can speak to J&J. 

e ial Just quickly, because | think more important piece Andy is asking about is info 
diffusion on the platform. We are seeing an increase in vaccine hesitancy early states 
where media had more attention, e.g., Georgia shutting down J&J earlier, so far increase 
in hesitancy only in Georgia. People are giving more reasons about why they are 
hesitant — lack of trust in govt, not sure vaccine will work, people more interested in 
waiting to see if vaccine is safe. We’re looking to see if we can ch messaging to 
users to some of these concerns. For example, decline in trust | ees - 
opportunity to push more local, authoritative people as spekespeople for information. 
Encouraging people not to wait and see. That doesn’t a pillover question, we’ll 
get back to you if we have something reasonable to share that’s good information. 

e Andy: Don’t wait to report to us to address spillover issues. Thank you for focusing on 
that. You can go onto the larger question. 

@ aa Want to reanchor on where we seem three biggest forms of problems: 

o Minority - disinfo dozen — actively pushing to remove — their patterns of 
behaviors have started to shi void policies — for example, they are using 
bitly links off platform. We’re Woking at all their identities and removing. Are 
they going to make mistakes so we can take them down? Vast minority of 
entities are actually maliciously intended. 

e Andy: Clarifying q on that group. Have you limited ability to share? 

e eal Yes — we haven't explained that they are feature limited to them. Hard to 
detect content if ofthe misinfo. We’ve taken other steps — removing 
amplification for Healta*Pages and Groups, but we don’t want to remove good content 
or downrank re-education opportunities. Push and pull to calibrate. 

e Andy: You don’t have algorithms that can tell the difference? 

° ame Our detection classifiers can find outright misinformation 

e Andy: Those are not shareable? 

° as) if we are able to identify and remove misinformation, if we can’t remove, we 
reduce wherever we can. 

e Andy: middle ground — how do you put caps on it. 

e — three mechanisms 

o Where to put hard product features in place — e.g., mandatory post approval by 
admins — slows down 

e Andy: Has that been done? 

e red yes. Another example, want to slow down the rate at which content can be 
produced. Good posts have bad comments. We’ve rate limited the amount of 
comments to slow that down. Goes back to containing when we can’t remove. 
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e Rob: This is a place where it’s worth zooming in, where the rubber is meeting the road. 
What are you trying? How is it working? 

e Andy: If you’ve done those things, can you measure the amount of shares of negative 
dis- or misinformation? Can you show us what those are? Last week it was 4%, this 
week it’s 2%? That gives us a baseline. We recognize this is an ongoing battle. We 
don’t know right now how big the battle is, whether we’re winning or losing. Then 
we’re able to not flail around and begin to focus with you on how to make it better. Is 
that possible to produce some kind of report? 

° al Before you got here — we can pull raw numbers. Those will not necessarily 
correlate with attitudinal changes. Because this is real world, we will see the numbers 
fluctuate. For example, with J&J, may see spikes. 

e Andy: So if you told me, we’ve gone from 3% to 2% but it hasn’t changed attitudes. 
That’s all we want; you control what you can control. Someday, re could be bad info 
about Pfizer, we have to answer honestly. FB isn’t accountable far that. FB is 
accountable for people getting truthful, reliable informatiog, not content that subtly 
changes. | just want to reinforce a lot of what Rob has ying. 

e al It would make a lot of our lives easier if when we delete content, we change 
minds. When we talk about constraint, that’s the best thing we can measure. We’ve 
had a lot of policy conversations, don’t want to go back to that. This is hard from 
technical and policy perspective. How to get the right information to the right people to 
get people vaccinated. 

e Andy: Happy to think through challeggegwith you. Depends on who is sending message 
— in mainstream newspaper that’s relfablef one thing, if comments that aren’t, someone 
with a misleading story. Drudge report had a headline yesterday — 6/7 million cases of 
J&J have problem- total disaster. Together, someone coming on that news for the first 
time gets the intended effect. 

e ee In terms of scale, that would make me nervous too. The technical challenge, 
building 

e Andy: We care aboutpests shared the most. 

e eel Can ask one question — what I’m hearing is — give us a better sense of raw 
numbers — those might flip and won’t show sentiment. We want to hear what we can 
do better — for J&J — communities in rural areas, MI, potentially more likely to take J&J. 
| don’t know the best way to go about reaching them. Would love to hear from your 
side how your campaign is reaching people so we can build into product. 

e Andy: over long term, if you believe govt/expert agencies put transparency and safety 
first, will pay off. If people get accurate information, feel comfortable that someone 
watching backs. Worries about being rushed are not as true. Black community — got 
very good feedback from black physicians, black activists. At the same time, people in 
conservative community, just as we were getting people off the edge, now people more 
likely to say right all along. If people do their own homework, we ought to trust them. 
Not everyone will choose to get a vaccine. If people can make own decisions, we’ll get 
over 80%. But worried about people being unduly influenced. 

e a | just want to be clear that attitudinal shift data on misinfo doesn’t exist. 
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® eal With inform strategy, on J&J side, we tried to put risks in context. If there are 
other things you want to get out, we’d love to see that to help inform people. 

e Rob: |! obviously care about attitudinal shifts, matters to me. | still feel like | don’t know 
what you are doing, what the metrics of success are. What are the 10 things you’ve 
tried? 

e ae to be fair, we are tracking that. Reduced VPVs, reduced ranking. What | can’t 
give is attitudinal shift. That’s the first time I’m hearing in those terms. That would be 
great for us to provide. We have hard policy constraints — things like Tomi Lahren’s 
post. Just want to be clear we haven’t declared victory. 

e Andy: If you added to that policy changes you are considering, that would be helpful as 
well. | will tell you this just to have Rob’s back, he gets asked this, it’s becoming the 
number one question. | would just ask you not to put him in a position where he says 
he doesn’t know. Better if he can say here’s what the data says, @f@re’s what they’re 
doing, this is what they are working on. Cy 

e ar Completely hear that. If I’m frustrated, it’s because we want to achieve the 
same things. What we can give you is data. 

e Andy: il | appreciate you being honest. | think it wilMee challenging for Rob to say 
that FB team is frustrated too. That kind of reaction would not go over well. We have 
to get past that. 

e Ewes To be extremely clear, reason I’m frustrated is not because it’s a big problem, 
it’s because it’s moving so fast. The 40% Marines — that’s coming from a community 
already hesitant. Comes from care. 

e Rob: Maybe | haven’t been able to art e — what do you need from me to get the 
information you need? 

e ie We’ll develop a report, get you data. We don’t want to send something that will 
be frustrating. We’ve got a good sense, from what Andy has told us on this call would 
be most helpful — dataapicture. We will and can get you a report, Andy. We’ve been 
struggling to get yo (a us able dataset. 

e Rob: Can we drill dowf6n that. | don’t need we saw 5% lift over X. | need — we tried 
XYZ, this is what seems to be working. What did you try? What is scaling? What was 
ineffective or political bullshit. Then a sense of what now. 

e Andy: What Rob just asked for, complements the data. Do get the sense that this isn’t a 
social media wide problem, it’s unique to FB and WA. Conversations are not as 
challenging — we have much more straightforward conversations with others. | think 
people believe you can solve it. Simplify to here’s what’s going on, here’s what’s 
working. 

e al this is my third meeting — Rob, we can pull that on the interventions. A lot of it 
will look like what we discussed two meetings ago. Product measures will look like what 
we've talked about. Haven’t thrown away a lot. Just want to manage expectations. 
Want to understand how we’re working with you in a different way than others. 

e Rob: | feel like we’re running around in circles. Some partners give us lots of 
information, some partners tell us to fuck right off. This feels like we’re chasing our 
tails. If you don’t want to give information, just say that. | don’t want to feel like I’m 
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going to a dog and pony show. My dream for FB to play ball. It’s about will we get out 
of this fucking mess. I’m not doubting that you are sincerely trying to solve this problem 
in good faith. I’m doubting that you are telling us everything or that you ia aren’t 
getting the resources you need to tackle this. Of 1% of vaccine info, this is what’s 
concerning, this is who is seeing it, this is what we’re doing. 

e teed Super helpful, appreciate the feedback. When | say want things from you all, 
just to improve our process. One example — we can’t do race targeting. Using SVI. 

e Andy: I’ve jumped into 3 or 4 FB conversations; each one has been almost exactly the 
same. |’ve asked the same questions with Rob. They all finish the same way. Good 
promise at the end. This is a new set of people; you’re hearing the questions for the 
first time. | can’t call Nick back and say that something is different now. Feels like we’re 
in the same place. 

e | It’s been 2-3 weeks, know Nick told you we’d be working eporting. We'll get 
that to you ASAP. | think Nick said at the time it would take some time to figure out. 

e tes What helps me is understanding is it doesn’t have¢o be qualitative. On the 
metrics — the most viral content is the authoritative con thought that wouldn’t be 
useful. We’ll look for faster qualitative bunch along with pfteduct info. 

e Rob: Two reasons why not useful — we see it in CrowdTangle. | don’t know if widest 
reach stuff is the problem, or stuff that’s in groups, private. 

° GaeFi Answer hasn’t changed 

o Disinfo dozen style people staying under policy limits 
o Authoritative posts with compfents and dialogues 

e Rob: What that implies to me that youthiAk there’s not a problem. So, tell me what is. 
If it’s far reaching authoritative but bad news. 

e a That’s why we didn’t send it. | don’t have the numbers on comments but 
pulling. The last thing that’s evolving — public figures 

e Rob: concept of disinfo.dozen is concerning — is it impact or subjective? 

e ran subjective ‘reas pn it makes me nervous — how do we stay below these lines. 
Maybe misspoke whefrt said frustration — relates to nuance and extent of the problem. 
| want to work with you on these things — scrappier faster data 

° S| Thanks Rob. We don’t want to be running in circles. We’ll get you something to 
react to. That will inform next steps. 
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6/15 Meeting with White House 


FB Attendees: 
WH Attendees: Rob Flaherty 


— Rob, | know we have a lot to cover. Want to respond to conversation from a little while 
back. Start off with the Policy changes we made on May 26. Then we'll walk through content 
demotion where we hopefully explain in a way where you're comfortable with it. And hopefully 
our colleague Ji will join to provide more context around the statistics we sent over on vaccine 
sentiment. Wanted to make sure we gave you Clarity there. 

Rob — sounds great. 

— |  — | lead the product teams working on integrity within FB App. 
Around the distribution of reducing problematic content, inform treatments I'll touch on 3 new 
misinfo experiences related to reducing distro of misinfo, touch briefly okey ranking works, | 
know we've discussed in the past, demotions are anchored in ranking, so 
then go to details of demotions. 

Rob — great 

HE — 3 new misinfo tools announced at end of May. Leveraged a few of them in election 
period. 

New approach — give people more info about Pages that have shared misinformation or have 
content that has been repeatedly fact checked. So now where there’s the case, you can get 
more information about what fact checkers ae) content on that page. Part of overall 


| gloss over that, 


inform strategy to give people more information? 
More aggressive approach to entities that haveWepeatedly shared misinfo — Pages or Groups — 
it’s typically the same sets of Pages/Groups. We've introduced logic so that we increase 
demotion strength/amount of demotion that we apply to those entities. This is one | was 
especially excited about. We know it’s the same set of entities that are repeatedly sharing. This 
one is key. 
Last one- improvement in notify people that they’ve shared content that fact-checkers 
later rate. We've redesigned notifications that the person gets to make it easier to understand. 
Additional info we’re adding in — fact checker’s article debunking the claim, prompt to share 
additional context with other people. 

— those are the three main new misinfo levers we’ve introduced. Any questions. 
Rob — biggest question is related to how demotion works. But to make sure | have it right — first 
one is a pop up when you go to like a page that tells you it’s repeatedly shared misinfo? 
joo | — yes. And includes substantive information about the fact checker. We can send you an 
example of what it looks like. 
Rob — how many times does the Page have to share to trigger treatment? 
| | — It varies across experiences. In this case, | think it’s 5. Let me follow up specifically. 
Want to make sure you have the most accurate information. 
Rob — I’m curious about notifications after sharing something fact-checked. In many different 
worlds ago, J and | talked about — the [J said it hardens people. What changed? What 
research have you done? 
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=| — | can’t speak to what was discussed earlier. These experiences have been being built 
for quite some time, have evolved. We've refined user research that told us that people do pay 
attention, there is value in providing this information, even if it’s after the fact. Nes a any other 
context? 
HM — was this around the election? 
Rob — this is when we first talked on Beto stuff — badging, notifying people. Research said 
counterproductive. | think this is a good thing. 

— | do remember that was our sense at the time — going back after the time. Let me go 
back to the teams and see. 
| | — We have pivoted substantially in the couple years I’ve been here towards a much more 
inform-centric approach. Another experience we launched last year — when a person goes to 
share an out-of-date piece of content or one likely to have misinfo in it, we surface what we call 
a reshare interstitial that informs people at time of sharing that content might be out of date. We 
found that as classifiers have improved over time, we’ve been able to otra targeted in 
approach, that type of information has quite materially slowed the sprea iral misinformation. 
A lot of this was over time improving our ability to classify, getting t opy and experience right 
— informative but not judgmental. Saying likely to be problematic ways, you choose if you 
reshare. We notify you there might be some issues. 

— external studies in this space are heterogenous in their effects. Quality of classifier 
really matters in prompts, even if after the fact. Also, nature of the topic itself. Tone in which 
you approach it matters quite a bit. One of those situations where it works sometimes, it’s not 
going to work all the time. You have to test and adjust it. I’m sure that improving classifier over 
time is what’s making this work. ¥, 

HE — and getting the tone right is also a key 

sharing. 

Rob — Tone is way copy is written? 

WM — right. We spent months of time landing the precise copy where we wouldn't be 
perceived as being paternali Landing the words was really important. We launched the first 
ones in March/April last ye e now used during election periods, other scenarios. It’s a 
powerful lever against misinformation. 

Rob — Cool, awesome. 

| | — | love this approach specifically because we are transparent with users. Demotion work 
— itis difficult to be transparent, give people a sense of how their content is being enforced on. 
In this case, able to be transparent and clear about the fact that the content will get less 
distribution, fewer people are going to see it. 

Rob — that makes sense. 

maa — Ok, I'll just cover context-setting COVID approach. We remove content that clearly 
violates our policies. Then there is a set of content that doesn’t violate but could be harmful, 
and so important to reduce the amount of times content is seen. Won’t spend much more time 
on that if that works for you. 

Rob — OK 

zd — | can spend a minute on how ranking works. Demotions, in their simplest form, is a 
discount to a ranking score that we assign to a piece of content. Zooming out a bit — there is so 
much content out there — each person has more inventory than they could possibly ever go 


tor. Can influence whether pause before 
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through. Ranking is important because it’s important to order what people see. Rank based on 
user value — determined by signals. What you might want to see most versus what | might want 
to see most. What we do is take all these different signals, assign a ranking score to a piece of 
content. Say there is a piece of sensationalist content, vaccine related. We assign a value — 
say it’s 10 — given all the different things we incorporate into ranking score. Our integrity system 
then calculates an integrity score or multiplier. In the case of sensationalist content — we’re 
certain that this piece of content is correctly classified as such — sensationalist content gets a 
demotion strength or discount of 40%/0.4. — we subtract 4 from 10. Piece of content that would 
have otherwise had a ranking score of 10 now has a rank of 6. So, when we stack rank or order 
the content after applying integrity score determines where it goes. Tricky piece is that ranking 
systems are deeply personalized. Difficult to say that a piece of content will rank in X position in 
everyone’s feed universally. Not how it works. But | can say this piece of content would be 
seen by roughly 40% fewer people based on demotion. That’s one way tosthink about the 
“under the hood” of demotion works. ©) 

Rob — this is interesting. If seen by 40% fewer people, who are the remai 

the audience differentiations? What kind of person can see it? 

— this is where the personalized nature of news feed come (and note I’m talking 
conceptually, it may not be precisely 60/40). One example is a low inventory user. So, if my 
dad only has 4 friends, there’s limited content for him to see. Another reason — connected to a 
page or group. Or if someone is scrolling deeper into feed than you or | might do. 

Rob — Reason | ask — seems plausible that 40% that are no longer seeing it are less susceptible 


to it and 60% are more open to it. Attitudinal difference. 
HE — | think that’s right - although we cay t&ay who it's bad for, or whether their attitudes 


are antecedent. 

— Thinking about that population — I’ve been asking the same questions — you’d have the 
40% might be the fence sitters. The remainder may have signal that they want to see it — 
they’re not fence sitters. They are the folks that won’t be convinced. There’s an argument that 
you're removing it from a ae | don’t think we have data to show it. 


g 60%? What are 


Rob — Devil in the details. d for me to make a personal evaluation of whether it’s making 
a difference. 

— If we wanted to understand if it’s making a difference, we’d have to randomly assign 
who gets demotion and who doesn’t and have some sense of prior attitudes. Given that this is a 
rare event. That random assignment becomes harder when you’re talking about content that 
others inject into the system versus our ability to inject content. With vaccines, it’s probably not 
exposure to one thing or exposure over a short time. At the point of the pandemic where we’re 
talking about vaccines, people have hardened/crystalized their attitudes. Hard to study. On 
integrity — we hope they are effective, taking steps because we don’t want the content up. And 
then there are times where we are actively putting things at the top of people’s feed. In that 
case, we control random assignments and can look at differences. 

— two other things. 

60/40 — don’t want to anchor in them, they are arbitrary. Could have used X and Y. 
This is where inform treatments become important. People who might want to see that content 
will continue to see it. With overlay of authoritative content pinned to the top — embedded 
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authoritative information — becomes very important. People can choose to engage. But in 
parallel, we’re providing a counter to that misinformation. Does that make sense? 
Rob — It makes sense. You guys are much longer on inform, we’re much longer on reduce. 
HE — what do you mean by that? 
Rob — we’re keen on what platforms are doing to reduce the spread of bad information, that 
platforms are not funneling people towards bad content. That’s our primary concern. If you 
guys have data that show that inform counteracts the spread of bad information, great. 

—itdoes. The value of inform is that we know that it does have an impact on distribution. 
Rob — I'd love to see that. 

— particularly important for borderline content where difficult for classifiers. 

i — a couple data points that have been really helpful for me. Search interstitial. | think we 
have data that interstitials do reduce borderline and misinfo shares. It’s a clear example of 
interstitial having a meaningful impact. Other data we have goes one stepefurther — proactive 
campaigns with CDC and so on. Able to measure causal and in some Ecegposive impact on 
vaccine attitudes. Another example of value of inform. 


Rob — | haven’t seen that data. 
ia — as with all marketing campaigns, depends on targe nd‘€opy. More than happy to 
share. 

— some of them were in Nick’s email. 
Rob — that was my last thing | wanted to get at wi me away that you weren’t 
measuring, then we saw that you were. Was that br Ow are you measuring? 
|| — Measured in a few ways. A lot of the o in NickWWote were brand lift or analogous 
(compare people exposed to content to ander group and survey). That’s one of the 
techniques we’ve used. In addition to that, have’done additional studies to try to attribute to real 
world uptake. Those take longer. Blood donations is a good example — when we rolled out in 
the US worked closely with American Red Cross — we were able to see with their data — 
increase of 19% increase nationwide of new donors. Using same techniques in this space. 
Direct brand lift, then broad y of work that goes all the way to attribution in the physical 
world. 
re All — | have to hop, Rob happy to follow up with whatever details might be helpful. There is 
some upcoming work on increased transparency that would love to chat with you about 
sometime in the future. 
Rob — Great, thank you. 
—a — We are able to do causal inference/impact analyses. The conversation we had 
previously was how can we understand impact of misinfo on people’s attitudes. That’s where 
we have a hard time studying. 
Rob — that makes sense. | actually do have to run also. | still have more questions, can email 
them to you 
PE - great. oo mentioned, we are doing more as a Company to try and make this 
easier to understand. Coming in the next couple weeks. We can follow up with you then. But 
send questions, we'll do our best. 
Rob — also interested outside of COVID in promotion of good information — NEQ score stuff 
rings a lot of alarm bells. Would like to dive in next time we talk. 
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7/29 CDC Call Notes 


FB Attendees: 
CDC Attendees: Carol Crawford, Jay Dempsey, Stephanie Gordon, Kathleen 


HE We can go ahead and dive in. Off the top, a few things. Wanted to let you know that the 
1-800 number is live if you want to give the call center a heads up. Don’t expect a huge uptick. 
Still figuring out how to do in Spanish, display that you need to press 2. 
Carol: Can you remind me how you see that? 
HE Should be in CIC —1 can send you a screenshot. Text is “For more information on 
vaccines, call 1-800.” Same number for Spanish but you press 2. We're still figuring out the 
best way to display. 
ME BB as a few follow up questions on misinfo questions. god cep into that, | know 
we discussed splitting into a misinfo meeting. What would be a good cadenée for that? 
Carol: If you’re seeing some things you aren’t able to act on, we’re_willing 
every other week or every week if you need. 

We want to give you some advanced notice. 
Carol: OK — Friday would be better. 

Great — [J do you want to take over here? 
eee thanks Carol for the help on these claims. Super helpful. | just want to go 
through these claims and make sure we have the right topline. The main two pieces of 
information we need: (1) debunkable or 2s Qt and (2) more insight into the harm that 


make the time, 


claim can lead to — e.g., implying vaccines *exist. So, to save you time, these two pieces 
would be great. Looking at list: 

Spike protein in COVID-19 vaccines is dangerous/cytotoxic debunked (1) harmless spike 
protein; (2) harm is general distrust 

Guillain-Barre Syndrome (GBS) is a possible side effect of the COVID vaccine (1) not 
debunkable, true for J&J? 

Carol: my understanding re GBS — potential adverse reaction, just on J&J. Have had some 
trouble trying to narrow down, this is good feedback. | will ask more specifically on GBS. 

|| No problem, these are hard questions. Want to save you time, give you info on what we 
need to action. 

Heart inflammation is a possible side effect of all COVID-19 vaccines (including non MRNA 
vaccines) may be debunkable as to non-RNA vaccines 

Carol: I'll confirm 

Bl Global catalog? 

Carol: | could not get an answer to it. Right now, communicators are looking at what to address 
and not, separately go to SMEs. We're trying to do a call next week. 

HE Helpful to speak with them, cuts down on game of telephone. 

Carol: We’re working on this on our own but happy to do your call too. 

| Makes a lot of sense. Even just hearing directly is really helpful for us. Our team is thinking 
through claims every few weeks. 

Carol: | think | can get someone to talk to a bunch of different points. 

mm Great — we can send the claims ahead of time. 
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Carol: | appreciate the very concise feedback. 
That's all | had, thanks so much again. 
Great, I'll work on calendaring that for everyone. jj andj ads items. 

On the ads front, | just had a couple of flags. One — Jay — we are almost good to go on 
the next round of ad credits. We had initially done $5 million, we’re ready to go with next $5M or 
remaining $10M (something HHS wanted to do). 

Jay: Just before this meeting, person managing ads for my team saw that $10M was added to 
our account and expires in December. Thanks so much for moving that forward. 

eee Great and thank you i for moving all this. 

Jay: | will second that, thank you very much Jj very helpful. 

So that is good to go. Only other flag on my end — | sent over an email with HHS too. A 
reminder that if you were interested in leveraging your ad credits for WA promotion, we can 
work with you on that. Wanted to plant the seed, make sure you were aware that’s possible on 
our side. If that’s something you want to do, some considerations to ares geruna review 
times, potentially needing a new ad account. That is a possibility if you’r 
Jay: Great, didn’t realize that was a possibility, we'll discuss on our @ad. 

Great — we met with HHS a few weeks ago and followed up'with email but wanted to 
make sure to share with you directly. 

Carol: | don’t remember the email, sorry about that. Will definitely discuss it with them. Sort of 
thinking might be better to leave WA in HHS lane given everything with messaging. I'll check 
with them. Oh, | see the email. 


BM Ok great. That's it from me on ads side 
Carol: | don’t think this is an ads question nde know. On WA — you all are notifying people 


through WA notifications about vaccine finder?™ft's only pushing a few thousand a week. Not 
sure if that’s a sponsorship or technical limitation? 
BE | think it has to do with how we ramp up to full speed. | think we may be in small 
tranches of testing phases to make sure we’re debugging before big rollout to millions so it’s a 
stable process. Don’t quot 
Carol: So not purchasing. ( ) 

| think it’s ours and not yours. 
Carol: Should WH/HHS revisit with re They want to push the notifications out quicker. 

We can facilitate that. If it’s with the WH, | would do it. 
Carol: Natalie Kates on the OMB team is talking about it. But it’s all the same group. Josh’s 
team. 
BE Clark as well? 
Carol: Clark is on that team, probably involved. 

| don’t know Natalie but do have a good relationship with Clark, | can reach out? 
Carol: Or | can just get you and ii on an email chain together. 
- Yes that’s great. Happy to help clarify. JJ — you had a follow up question. 

Let’s do this going forward — since we just went through these 4, if you can help us resolve 

this batch via email, we can then reconvene and start SME call after that. 
Carol: Great, will try via email, and if | can’t, will let you know. 


Just wanted to clarify, thank you. 
Great, that’s all on our end. Carol, anything else? 


erested. 
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Carol: No 
HE Great, we'll give the time back. Carol, will look for that email on WA and we'll look for 
misinfo meeting in next few weeks. 
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4/8 CDC Meeting 


WE agenda for today: CrowdTangle, research, misinfo — any questions 
Jay: Was going to ask question about Instagram stickers, but saw you sent material over 
GE ce! free to ask any questions over email too 
Jay: Sounds good 
GE Wil! start with CT overview, how to look at vaccine messaging trends, use for 
misinformation. Would love to have a discussion after the demo, how best to tailor reports. Will 
turn it over to 

I’m ,on CT team. Have been building out the reports on CT that you’ve been 
getting. Will share a presentation. Want to show you searches — some of them are already 
highlighted in our reports. Want to show you how to find themes. 
Slide 5 — last report | sent to Carol — looking at vaccination/pregnancy/fertility — we include the 
search terms at the bottom and a link to CT search é 
When you go over, keywords load in, with date range, Pages in US — show*posts with keywords 
— sorted by most interactions (reactions/comments/shares) 
What you can do here — you can modify the search to look at di nt versions — you can 
change keywords, change search. 
You can use filters — change time frame — timeline shows change in volume of content in our 
database over time — search covers CT database — not every single post on FB or IG. We 
automatically pull in all verified FB/IG accounts, accounts that have 50K followers or more, US 
groups with more than 2,000 members — wonsee private group conent or regular users 
Once thing you can do — can change cabo By local relevance filter (beta test filter), Page 
Admin country filter 
Jess Kolis (CDC): Can you look by type of reaction? 

In search, can break down by most comments, most shares. If you download, you can 
break out in the CSV format. You can weight sorting by type of reaction in dashboards. You 


can also look at high comm nd high shares. 
Jess Kolis (CDC): Thanks 


| | Local relevance — filter that looks at accounts in database and looks at relevance to 
particular location — city or state level. Can use for groups. So if we search Local Relevance by 
California, not necessarily based in CA, but relevant to CA. 

How to narrow searches — start with a general search for COVID and vaccine keywords — try to 
do English and Spanish, different spellings 

Comma is an OR 

We also have Boolean search tips right next to search 

So after initial search, look through results 

Also look at overperforming post — post getting more engagement than usual for the account 
that posted it 

| also look at most shares 

Sam Huxley (CDC): One of the things we were hoping, we're pretty familiar thanks to CT 
training — we were hoping we could have access to set up our own dashboards 
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Chris Lewitzke (Census): You mentioned not getting into dashboards today. But want to make 
sure whatever is set up for CDC, we’re able to get access to. For example, local relevance filter 
not turned on for Census. 

On access question, we can circle back. 

: Local Relevance is turned on in CDC account, not all accounts across CT. 
We can work to combine since you are detailed. We can make sure you have access to same 
features that you were using during the Census. 

| know last week, we left off on pulling in more regional/global insights. Would 
love to hear from CDC what else would be helpful. 

Sam Huxley (CDC): Regional part first - we’ve seen quite a few instances, in India, infertility 
misinformation really took off there first, certain aspects of it. There are markets like that that 
are dynamic, want to monitor, see how widespread it is. With the caveat that we do not have 
robust non-English queries set up. India has been one. UK, EU, cy hve a lot of 


activity that then gets picked up here (e.g. AstraZeneca). Australia, since they have a very 
active and organized antivax community. Those would be the priority mark€ts. 

Jess Kolis (CDC): It’s challenging to limit geographics to certain,countries. We have strength 
based on WHO work — Francophile Africa, Eastern MediterraneangArabic. As we think globally, 
maybe a separate conversation down the line. Global issue — just because it starts in Africa, 
may come to US and vice versa. 

Sam Huxley (CDC): One other point — we're also liaising with Global Engagement Center at 
State Dept. They’re also giving us insight to markets of concern. Pacific Island nation content 


on religious norms makes its way here. 
HM We do have a bunch of COVID 19 hig by country that you can share with your 
countries. For you all, is it more useful for yo come to us with things you are seeing, or for 
us to flag things to you? 
Sam Huxley (CDC): Ideally those aren't exclusive. We always welcome inputs, what you see on 
platform. CT helped us integrate reports. For example — counterfeit vaccination cards. That’s 
the kind of stuff that if you se@first, we definitely need to know. 
ie ei I can step in on tnakce Pino, that’s part of the dialogue of sharing insights. More to 
come. 
As next steps, Kelly you’re sharing the next report on Monday? 

yes, that’s right. Let us know if it’s helpful. 
Carol (CDC): | was going to suggest that they continue sending the report you’re doing. Other 
people are using it. 
Sam (CDC): we've set up three themes — death, infertility, general side effects. Trying to align 
around that, orders of magnitude. If that’s reflected, that’s great. Things like fake vaccination 
cards, left field issues, we like to update and get into reporting as quickly as we can. 
Pe AI Sounds good, we’ve seen those themes. We can get you set up with dashboards, set up 
notifications. 
HE we're at time. Any last questions? 
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4/15 CDC Call Notes 


Attendees (CDC): Carol Crawford, CDC Health Equity Group — Jessica Franks, Ursula Phoenix 
Weir, Bola, Stephanie Smith, Kim Williams, Abimbola (Bola) Ogundimu 


Attendees (FB): 


Note: | was only able to join the Teams meeting by phone due to technical difficulties — the notes 
below reflect my best effort to determine who was speaking from CDC side. 


| Carol, because of time, will skip intros of regular folks, but we can intro the folks working 

on equity? 

Carol (CDC): Sounds great — Ursula and Jessica want to do intro 

Ursula (CDC): Associate Director for Communication Science at Natong Bip Defects Center 

Jessica (CDC): Jessica Franks — Strategy/Partnerships Comms Lead — f Health Officer Unit 

— Coordinate closely with office of minority health and health equity ADeputy Kim Williams is on 

the Call 

Bolo (CDC): Partnerships lead working with Jessica 

Stephanie (CDC): Joint information center liaison t 

Want to quickly introduce two of our folks 

'm BM. head of health, lead our health work py to answer any questions that 


come up 
LS I’m on our social impact product eats on equity, lead our equity strategy for 
COVID-19 launch 
aa | | think because one of our team members has to drop, we can do an overview and then 
move to questions? 

Would love to walk through equity strategy — for our equity strategy, we’re focused in the 
US on vulnerable communitieS“facing vaccine access challenges — socio-economic, 
transportation challenges. Bleckend LatinX communities, rural communities are facing 
challenges. We've talked to a number of folks, partners in health policy — Kaiser Family 
Foundation, CDC Foundation, WHO Foundation, health officials, CA Dept of Health, health 
equity algorithm expert — have helped us think about SVI. Strategy focused on factors — lower 
intent to get the vaccine due to concerns about safety and side effects and access challenges. 
Strategy — show trusted messages that people in vulnerable communities can trust, are 
informed by authoritative sources. In many communities, that’s public health figures. Want to 
deliver messages through trusted messengers — faith and community leaders. Also thinking 
about how to use our own targeting for folks to see trusted vaccine info — when and where to get 
vaccine. E.g., vaccine finder. That’s a high-level overview. Would love to hear any questions 
you have. 
Ursula (CDC): You mentioned trusted messengers — who are they? 

Yes — looking at who is resonating, who do people follow? Who are partners we should 
work with based on expert guidance (e.g., Kaiser Family Foundation)? One example of a 
trusted messenger — working with Kaiser Family Foundation to amplify messaging with Black 
Doctors Coalition. 
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Stephanie (CDC): Is that what the ask is — collaborating with CDC on amplifying our messages? 
ME We're so appreciative of your time — we'd love your guidance on who you think we 
should be working on, messages we should be amplifying. Would love your thoughts and 
guidance. 
Ursula (CDC): One major thing — aligning all messages going out with CDC Health Equity 
Strategy — relate everything back to that. Stephanie, thinking of Health Equity style guide, that’s 
internal. Around language we are using with health equity. Are you saying you’d want us to 
develop messages, or wanting to hear what’s most important? 
Soe di Don’t want to make any asks or create more work for you, if existing work or things you 
are hearing, would love to hear. We're looking at all the guidance you are publishing, extracting 
nuggets and messaging. But if there are messages you know are particularly effective w/in 
vulnerable communities, would love to hear that. 

We can always come back if you want to think about it. Was wogdering if you could 
share a bit about your strategy? S 
Ursula (CDC): | can pull this up from the website. There are four prioritie 
focused around: 
Expanding the evidence base. 
Expanding programs and practices for testing, contact tracing, isolation, healthcare, and 
recovery from the impact of unintended negative consequences of mitigation strategies in order 
to reach populations that have been put at increased risk. Examples of potential unintended 
negative consequences include loss of health insurance; food, housing, and income insecurity; 
mental health concerns; substance use; "<i. resulting from factors like social isolation, 


at everything is 


financial stress, and anxiety. 

Expanding program and practice activities to suport essential and frontline workers to prevent 
transmission of COVID-19. Examples of essential and frontline workers include healthcare, food 
industry, and 

correctional facility workers. 

Expanding an inclusive wor equipped to assess and address the needs of an increasingly 
diverse U.S. population. Cy 

See: 

https://www.cdc.gov/coronavirus/2019-ncov/community/health-equity/he-in-action.html 
<https://www.cdc.gov/coronavirus/2019-ncov/community/health-equity/he-in-action.html> 
https://www.cdc.gov/coronavirus/2019-ncov/community/health-equity/cdc-strategy.html 
<https://www.cdc.gov/coronavirus/20 19-ncov/community/health-equity/cdc-strategy.html> 

it = > Any key concerns you are seeing in vulnerable communities, trends we should be 
addressing? 

Stephanie (CDC): | wish | would have prepared a bit better — | have a list of things we want to 
do around this. We could compile a list. 

Ursula (CDC): One thing we could do — one of our main goals is to work with task forces across 
response. Something we could do — follow up more on the ground workers, task forces, to get 
some of the things they want to prioritize, circle back with you all. 

Jessica (CDC): (couldn't tell who was speaking) — we can follow up in writing, that might be 
helpful 
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il That would be great — working with vulnerable communities will help us close the gap. 
One thing we’re thinking about — differences that exist in vulnerable communities — e.g., urban v. 
rural. Conservative Republicans — how to reach them. Would love to know if we’re on the right 
track. 
Jessica (CDC): Absolutely think you are, you’re asking the right questions. 
Stephanie (CDC): We could pull together some messaging. 
P| If there are key groups that are coming up, we should be focusing on, we can make 
sure messaging is informed by key concerns of those groups. 
Carol (CDC): We can do that too. Sounds like the main offer from FB — take priorities, 
messages, key audiences — factor them into your existing efforts and projects. Payton’s original 
email sounded like trying to get experts in front of opportunities FB had? Anything else on that 
end? 
| | That is true — we do have the opportunity to pull CDC experts, people you want to put in 
front of audiences, we have that access across FB, IG, other events. he ge someone a 
platform, just want to make sure we work with you first on who we are highlighting. That’s an 
offer that’s on the table. We own WA, IG, FB. We just had one wit@Or. Fauci and the Shade 
Room. That’s a strong offer. Sometimes we get an opportunity toybring to you. Happy to plan 
something out over the next few months too. 
Carol (CDC): Don’t know if Jessica and Ursula are aware of any efforts like this or if something 
we need to think more about. 
Ursula (CDC): | don’t know off the top of my head but will look into it. 
Carol (CDC): Nice offer we should explore, thanks for explaining it. 
=a Want to make sure we're putting ouRe forward — just because we haven't 
presented something, you can still come to us ideas on things we could be doing. 
Bi Just to add, would be good to understand what your goals are and if there are things we 
could do to support it. If there are videos trying to target, we could help with that — could be via 
ads. We can help amplify content. There may be people highly influential that we could help 
identify them and have therngpest. Just some concrete examples. Just want to figure out how 
we can help as much as chibi 
Carol (CDC): That’s great, appreciate all that information. Jessica or Ursula anything to add? 
Jessica (CDC): | don’t have anything to add but this is a big offer — thank you! We'll compile 
things, what we're looking at, focused on, goals, and go from there. 

One more Q — are you thinking about these groups in terms of racial groups, locations, 
areas? How to reach different groups/subpopulations? 
Jessica (CDC): In terms of messaging? Audience segmentation — on the link Bola sent — Health 
Equity in action page — list of populations in action. Not exhaustive but lists audiences we’re 
prioritizing on getting messaging out. Some intersectionality, overlapping. Stephanie, anything 
to add? 
Stephanie (CDC): Looking at based on group and location (sent this list via chat function on 
Teams): 
Racial and ethnic minority populations 
People living in rural or frontier areas 
People experiencing homelessness 
Essential and frontline workers 
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People with disabilities 

People with substance use disorders 

People who are justice-involved (incarcerated persons) 
Non-U.S.-born persons 


really helpful, thank you 
= For context, we don’t normally have Product on because they are building products — 
that’s why they are asking specific Qs. Want to help over the next few months as we try and get 
to herd immunity. Unless any last questions, can turn over to you Carol. 
Carol (CDC): Really do appreciate the Product team’s time. Health Equity team joined last 
minute, they'll get more info, now they know FB has this whole unit to work on it. No other 
questions on our end. 


WE ‘cally appreciate your time, here to be helpful. Thank you! G 


eS 
& 
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Fro TT PEE com> 
Date: Thu, 11 March 2021 12:48:40 


BCC: 
Subject: Notes from 3/11 CDC Call 


Hi all, 


Recap of today’s meeting focused on WhatsApp and ads below. TLDR Gey re interested in 

moving forward with the WA bot but need to learn more about BSP optio nd get the in kind 
donation approval, which will take 1-2 weeks. We'll also schedule eeting with them to run 
through brand lift results and give some preliminary infor, 


For ease of reference, here are our action items. 
into our review process for USG comms on COVID? 


we best loop the WA team 


Prepare CDC in kind donation paperwork for WA bot to send to CDC Ga 
Schedule Brandlif/FMP call Gi 
WA team to prepare information about chat botand BSP options to send to CDC - note if any 


BSPs have worked with federal govt ) 
Prepare HHS ads credits email Compliance) 


CDC Meeting — 3/11 


e’re excited to receive the note back that there might be a potential path forward. We 
sent an email across yesterday outlining next steps on a WA solution for the LatinX community. 
Upwards of 40-50% of our users are part of LatinX community. What are you thinking about for 
content? The content is yours, can work with development partner to put in WA API solution. 
Carol: Don’t think | saw an email yesterday. 
| don’t think we sent an email across but we can follow up. 
We'll follow up with that. Wanted to talk through content, having a dedicated POC we 
could work with 
Want to introduce EE who will be helping with content development, 
also have [I on to support on this project for vaccine task force. Carol, ok to run 
through proposal? 
Carol: Absolutely 
BE We've put together initial proposal, we haven't put pen to paper on the wording. We'd 
appreciate any information on best practices or wording. We really want to focus moving people 


og Today going to run through WA bots and then Ads. 
W 
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from contemplation to action. Feeding them prompts based on where they are in vaccine 
decision. Something like — 

| want to learn more about the vaccine before | make a decision. 

| know that getting a vaccine is important and | still have questions. 

I’m ready to get vaccinated, how do | do it. I’ve been vaccinated, what’s next. 

Within this, would have answers on common concerns. Safety, why impt to get a vaccine. How 
to find vaccine in their area, what to expect at an appointment. One other piece — want to be 
able to track as they move through, always feeding vaccine finder or a question asking if ready 
to get vaccinated. 


hat all sounds good to us. If this information exists on CDC website today, other website, 
we can review and propose how to migrate to a chatbot format. We’re oy take and review 


og what message can we feed them at the end — what will help people. 
. 


as homework. On promotion piece — you may use FB ads to get the word ouft about WA chat 
bot. Maybe have a dedicated optin to WA. We can identify the best way romote, users 
need to opt in. Sounds like what you’re describing is a chat bot.witfinformation and a 
reengagement notification. 

We had a few questions — wasn’t clear what ability we have to push out to people. 
What options are available to send notifications? 
mm Support what we call transactional notifications — personalized, one time notifications. For 
example, opt-in for scheduling, get a reminder. User has to opt in and agree to be contacted on 
WA. Could be multiple notifications — reminders to show up, second dose notifications. What 
we haven't allowed, but is in active sci te generic blast notifications (e.g. daily 
update on COVID cases). Happy to take that 
notifications. 

You mentioned the Vsafe — if we were to integrate any of that, we’d push over to 
Vsafe. Would be you’ve been vaccinated, make sure you've enrolled in Vsafe. 
= One thing, not sure if ntioned before — for all notifications, waiving fees for 
notifications related to app nts through June 2022. 
Carol: That is helpful — that reminds me, Payton, you were going to get me something in writing 
to get in kind approval. 
| | That’s right — we have FMP, ads, and WA. We can do that. 
Carol: So much easier when you send that, would be awesome. 
esl We send your vendor the fee waiver we work with Compliance on, that’s then passed on to 
you. We've done for 8 governments now. 
Carol: Fred, are you hearing anything on a technical end we should dive into. | didn’t catch it 
would be a third party vendor 
| | Would need to look at what information is stored and used by 3rd party vendor from a 
privacy/security perspective. 

We can share information on our partners with you, can take that action item. 
Any other questions Leslie as we’re setting up content? 
As people pick certain prompts, will we get that data? Will we know demographic data on 

who is using? 


k if there is a use case. But personalized 
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al You can get some of that information through vendor, on demographic info, can build on 
client side. We don’t have that on WA side, only need phone number to set up. 
Will we translate with MLS into Spanish or is there an option to work through 
3rd party vendor or WA? 
With WHO we have in 18 languages. | can’t recall how we structured. 

We can be flexible. In WHO case, was a mixture of both. They had in house teams for 
core languages/UN official languages. For the other languages, they worked with our 
localization teams pro bono to make available. If you need assistance from WA, we have a 
passionate group internally to help with your approval of the output. 

Updating material — everything is changing so fast. How do you update content? 
. It’s a great point — in WHO case, we have a master standard language in English, tabs 
in other languages. We have a good cadence for reviewing and updating. That’s why it’s good 
to have a CDC content POC to make sure we stay organized. 

Will we be able to edit content? ‘Ss 

Yes. To update real time, we can train you so you can go, into d 
the content 
= Other languages beyond English and Spanish? Have a larg&Indian-American group, other 
groups on WA. 

RE | think we just want English and Spanish first then see if we need to expand. 
Carol: We need to get this approved with in-kind wording, which | could get done in a week or 
two. We can prep and get ready but can’t launch until approved. What’s the next step? 


Hc recommend we send you a list of hey — it’s your choice who you work with. With 


oard and update 


your guidance, can set up a call with develo ners. Then it’s really just diving into the 
content. Not sure if you have someone to be a%groject manager. We're excited to move as 
quickly as possible. 

ies As far as vendor list goes, would be helpful to know if any of them have done work with 
another federal agency. Doesn’t have to be health related. That’s highly helpful. 

Carol: Now it’s coming bac e, we mentioned how you guys were going to help us rather 
than pushing this to a third Kero because we all agreed that what happened with our FB 
Messenger project wasn’t ideal. Are you saying you'll be more involved this time? 

BE The project team will be me and [i we won't just push you to BSP, we'll be with you 
every step of the way. This is high priority for us. This is the case for WHO, UNICEF. 

WE This is a different model, that's why they want a POC. We don’t want that to be 
stressful for you from the learnings of last time. Don’t want process to get in the way. Want to 
pause — | know [J has some updates 

is 4 Sent a note, not sure if you have seen yet. We do have the measurement results back, 
happy to set up a time to go through them. Overall the results were fairly decent. Mixed results 
based on the question. Glad to see we got it off the ground, can use in future campaigns. 
Carol: Great, we can set that up. Would also like to have a separate call on FMP. 

Depends on what we want to talk through about FMP — if onboarding, separate. If 
content-related as relating to ad campaigns, we can merge them. Why don’t we schedule 
measurement call, integrate FMP, and then can schedule follow up if needed 
ME | know you're still processing ad credit donation, Carol 
Carol: yes 
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BE GE 2d credits coming — will have formal email for you to process. Any other 
questions? 


Carol: RY will send wa POC. J RY and | will look at vendor list. J will 


send in kind note. 
HE Yep and will set up measurement/FMP meeting. 
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6/23 CDC Call 


Carol — can we start with questions? 
— sure 

Carol — first question — when we were on the phone with &) one question was whether put 
VAIRs, huge topic for vaccine misinformation. i was going to think about it? 

— | know it was in active conversation, we'll check in with Liz on that. 
Carol — HHS called, Josh Peck’s office called. Not sure a has reached out. They're 
apparently working on some quizzes related to COVID vaccine, planning to use on page, in ads. 
They wanted me to ask you guys if you’d be willing to do a quiz question. We’ve done more of 
this on Facebook than IG. 

— are they referring to FAQ on COVID Info Center? 
Carol — that would be a place to update, but | don’t think that’s it. C) 

— you mean the QPs? 

Carol — yes, | think that’s what they have in mind. Did tal you? 
BE — she didn’t there was a lot going on. So QP to Quiz? Ora Q&A as the QP? 
Carol — directs people to go to landing page 

— The other thing to think about — there are , &A on IG and FB stories. We can definitely 
see what things Product has up their sleeve. 
Carol — | will email you the question. | know been working with them on that. 
BE — | had suggested IG sticker Quiz o on on FB. They didn’t want to do 
that because it wouldn’t show the correct a r percentage of votes. 
| — got it — there are lots of fun ways to interact, get some more engagement. Would be 
good to see length of question. Interesting — if audience is for kids, young parents, lots of way 
to do it. 
Carol — And of course, HHS is looking for something much grander, bigger. Next one - 


@cdcmuseum — having cans it verified. 


— you can send that 

— that’s their IG profile. They submitted whatever they needed to get verified, not sure 
if any updates. 
a —| don’t have access to the system, but I can submit it. 
Carol — lastly, we're starting to think about school year to parents and school administrators. 
We want to work with Pages/influencers to get messaging out. 
fen — Obvious group may not be helpful, AFT. Might be interesting to reach out to FB groups 
of teachers, moms, parents. Celebrities will have kids. Have you thought about Dept of 
Education? 
Carol — we haven't. FB Groups is a fantastic idea, don’t think we’ve done that before. How 
does that work. 
inna — Pages can join groups — CDC Page could join groups. 
Carol — got it, good suggestion. We don’t have the guidance on it yet, sensitive subject. I'll 
reach out in a few weeks. 
| — could also think about actors who play teachers on TV. 
Carol — Are you talking generally about celebrities? 
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— there are thousands of different permutations to think about, if you get settled, happy to 
try to help. 
Carol — that’s my list for today. 
— no items from me 
— I’m wrapping up a few things, will do via email. 
— In that case, no items, we’ll work on these items Carol and get back to you. 
Carol — thanks 
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3/12 White House Meeting Notes 

hes know we only have 30 minutes, want to jump in. We scheduled this time to start a 
discussion to get you familiar with how we're thinking about approaching borderline 
COVID-related content. Want to have i and who run our 
proactive work on misinformation. You may remember from the work we did around the 
election. I’m going to turn it over to Andy to kick off. We welcome your questions at any time. If 
we have follow up, happy to schedule subsequent meetings. 

Rob: | can go a little over 3:30 if we run over. 

Andy: Hi I’m Andy, lead product policy team. Work with teams like Newsfeed and Search. | 
know you've already talked with my colleagues on misinfo. Will focus on barriers to vaccination 
content. 2 pronged approach — amplify authoritative info ( | and address barriers to 
vaccination (me). We've been working on vaccine content for years, have worked with Vax 


confidence project, CDC, WHO, academics 
Andy: Want to walk you through barriers to vaccination content and row{ourptewentos can 
encourage people to get vaccine. We've worked to organize content an likelihood it will 
affect people’s decision. 

Outright health misinfo — e.g. vaccines cause autism, no one shold get the vaccine, etc — we 
remove this. Once we get past that, experts have told us removing everything isn’t the right way 
to handle. So want to run through. 

Sensational/alarmist vaccine content — Posts like “Are COVID vaccines a ticking time bomb?” — 
also explicit criticism — post that says oh taking grandma to get vaccinated, you’re a murderer — 
experts tell us to focus on reducing owe ina than outright removal for fear that it will 


contribute to conspiracy theories. So we lintii~’ search, don’t recommend, reduce distro. 
Promoting vaccine refusal/encouraging alternate remedies — e.g. why get a vaccine for 
disease with survival rate of 99%? It’s a question — experts 
True but shocking stories — here we get into mainstream news content — e.g. doctor dies 3 days 
after getting COVID vaccine — may be a barrier, is true, but still problematic — appropriate 
response — don’t recomme en people come across — inform them about vaccine safety, 
etc. 
Objections/skepticism discourse — for this content — approach is largely inform — identify large 
entities that collect this content and don’t recommend 
Personal choice/belief — no vaccine for me, not moral 
Concerns about the institutions or vaccine development process — can we be sure it’s safe 
Other vaccination and debates — not sure what to do for pregnant women, children — experts tell 
us that we shouldn't intervene 
Andy: That’s the basic taxonomy we’re working with. | can talk in more detail about how ranking 
works. But can answer any questions. Then we can go to incredible work 
Rob: Thanks, also MM (?) from my team is on. 

Can you add a bit more context, how does this differ by format type? 
Andy: Let me address MM your Q first — it's the same approach for text/video/picture — 
with some variation on Al. Turning to definition Q —- NewFeed is your FB inbox from family, 
friends, Pages, Groups — they are all in your NewFeed. Could be 2,000-3,000 posts on any day 
in US, a user would only get through 100 or so a day. Four components: 
Inventory: the content you've chosen to follow 
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Signals: The info we have about the post or you — people have different preferences for video — 
type of post, signals about quality of content (meaningful to others?) — tens of thousands of 
signals 

HE This dovetails with question about your content 

Andy: Got it 

Signals — some are surprising — strength of your WiFI is a signal — won’t put video if you’re on 
plane wi fi — those signals roll up to a couple dozen predictions — what is likelihood that if we 
show you it will be meaningful, likelinood you will watch or share a video, etc. 

Predictions are weighted for a relevance score — high is good, low is bad. Throughout all of 
this, borderline CS violations, clickbait, etc push ranking down 
— ranking is sort of a spam filter for your FB inbox - 

Rob: Certainly helpful — my question is in terms of reduction — what scale of reduction is 

happening. Big, big question | have is how big of a problem do you hav re? What is the 
volume of content that falls in these categories on a daily basis? How ys demoted but still 
available? We see that FB is a high news source for vaccine skeptics. 
Andy: A couple thoughts — impact on vaccine intent is how we me e interventions. In terms 
of how big is the problem? We look at what we can do to move the,needle. That’s how we think 
about it. To scale the COVID discourse — about 5-6% of content is classified as newsy or public 
affairs. | know that’s surprising — for example my newsfeed is disproportionately about news. 

For other Americans, mostly photos of babies, birthday parties, and comedy. So while it’s a 
small amount, we have been spending billions a year to get it done right. 

oo] Rob, when you say you’re hearing fromyexperts outside of Facebook — who are your 
sources for your info, what is the info? Thar us to respond, take a closer look at what 
you’re hearing. If there are specific pieces of data or research, would be helpful for us to 
understand and know what it looks like. 

Rob: It’s data we get from HHS about news source and propensity to be hesitant. Facebook is 
a big source for vaccine hesitant people. | hear that people have different experiences on FB. 
We have CT, that’s helpful. Btwit’s still a black box. We’re not seeing what vaccine hesitant 
people are seeing. You raga to data about concerns that people have. That’s really 
useful to us. It’s good to hear how the algo works. I’m looking for what is the universe of 
vaccine hesitant content, what interventions are working? We all recognize there’s a problem. 
Want to hear what you’re seeing. 
ha So the survey data that we talked about two weeks ago — that answers several of your 
questions, including what messaging is helpful — turns out it’s their local healthcare 
professionals. We'll send that by EOD. A lot of it is as expected. I’ve had formatted in a few 
different ways, will come to you. 
| | To the point of having a level conversation, we want to have that with you. This is nota 
one off meeting, we can take that back, see what we can do to produce something helpful. If 
you have specific data points, we can always take that back. 

Rob: The thing that would be helpful — of those categories, what is producing the most 
damaging outcomes in terms of our goal to get people vaccinated? It seems to me it may be 
the stuff at the bottom of the scale — the more persuasive. But | don’t know. | just want to know 
where we need to target our resources and messaging. 
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HE One of the big findings too is about side effects — a very stable rate of individuals 
concerned about side effects. Once you read this, may inform messaging. Also called out 5 
different states re hesitancy/efficacy. I’m hoping this will be an informative data dump. 

Rob: Can | ask about downranking, efficacy of it. What does it look like before after intervention. 
Andy: 2 different ways to get at it — how effective are we at detecting the content — depends on 
how long classifiers are trained and depends on language. For misinfo, we’re in general pretty 
good in English/Spanish — it’s harder in more niche languages. Sidebar — we're trying to do this 
all globally. Other way — how effective is the suite of interventions at addressing vaccine 
hesitancy. That’s our north star. 

Rob: What are you seeing? 

Andy: | think will have something to add here, may have that in the report 
mentioned. 

| | If there are lists of specific things you want to know, send it to us. With guidance, we'll 
turn around. On the proactive side — this is the voting playbook. | can Gingucn in detail or 
key points, what do you prefer? 

Rob: key points for now 


This is a little different from voting — we heard that voting messaging actually started to frustrate 
users. So with vaccines, don’t want to end up discouraging users. On fact based questions — 
doing proactively in newsfeed, starting next week, you'll start seeing this more prominently. It 
won't be top of feed, but in feed. 

Social norming — we're working with you on prefile frames, that will help. We're also working at 
identifying public figures who can talk aout et vaccinated it — all the way from celebrities 
like Dolly Parton to local influencers within communities. One thing we've heard, those with 
national and global presence, they are waiting for CDC to tell them what to do. They tell us as 
soon as WH or CDC tells us what to do. 

As states are ready, will be encouraging people to check their eligibility. Will send people to 
vaccine finder, partnership with\BCH. Will vary state by state, whether states can handle the 
traffic. Working closely wit Ss 

We have expert advisors in vaccine comms and messaging. We’re working with in-house 
experts, external efforts as with voting. If you have suggestions of people we should add to that 
group, or want to be part of it, let us know. 

Rob: Can you elaborate on last point? 

= We're going to pull group of advisors together weekly to discuss language for campaigns, 
Rob: Are you upranking pro-vaccination content? 

ae | Ranking stuff, | will let Andy speak to. In the unit that we curate, which we can send over, 
we are including pro-vaccination content. That’s not from your friends. That’s why profile frame 
will be so helpful. 

Andy: The short answer is yes. The most popular posts around the world are from CDC, 
UNICEF, WHO with pro vax 

HE can you tell us more about pro-vaccine website? 

Rob: It’s vaccine finder — still working through that. 

HE we want to make sure if we send traffic to you, we don’t crash. 
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Rob: we'll follow up on that point. | want to go back to profile frame being most impactful — 
based on data? 
Ea It’s a hypothesis. All of the content has rolled out to eligibile populations. The profile 
frame for social norming — seeing your friends do something is a super power of social media. 
We saw that with voting stickers. People respond seeing their families and friends that they 
value and respect doing something. 
Rob: differences with FB and IG, programmatic stuff? 
HE t's not universal but pretty consistent. FB focused on community, IG focused on 
creativity and self-expression. We have one big team across family of apps coordinating 
though. You might see a different product experience on IG from FB but working to get parity 
across of them 
Andy: MJ and | work for Inc — which is all the apps. IG much more focused on influencers 
and celebrities — people have fewer friends — ranking is a less important lever. Getting 
celebrities out there is even more impt on IG side. C5 
Rob: WA interventions? 
ax. We're primarily working on setting up govts and health = with messaging bots. 
Something we did with voting in the fall. Want orgs to use for app&scheduling. Leaning into 
partnerships there. 
Rob: In theory, you could put something on the homepage. 
HE Proactive side is more focused on FB and IG. 
Rob: This is great, | will look out for the data that you have I'm happy to put a list 
together. We want to know where the issues are, what impacts the interventions have, what are 
the most pernicious things we need to deal Gif ye continuously be poking at those things. 
I'll put together a framework. 

We have an announcement coming next week on our tools that we’re rolling out to help 
people find how and where to get vaccinated. Will get you details about that. Wanted you to 
hear from us. 


Rob: Awesome, thanks. 
a let me know on CT 
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For i Of com 
Date: Tue, 23 February 2021 10:04:30 


BCC: 
Subject: Read Out of Call w HHS and WH - AC PRIV 


USG: Clarke Humphrey; Courtney Rowe; Joshua Peck; Robert Flaherty 


HE introduction of team and what we have done over the past year — in particular ad credits, 
and also introduce Frames. 


Wanted to provide some clarification around our donation to His wg have put together 
an initial budget to meet 80% of population 2x/week for 4-6 weeks — our practices. So 
$15M to HHS, $15 to CDC, and $15M to state and local partners. go towards various 
topics to encourage vaccine uptake. Can also provide FMP (FB Marketing Partner) to work with 
you. And if there are other ways we can support, open to that as well. 


We definitely want to make clear that we want to meet the moment — we have 
come up with these numbers based on our best practices, but want open comms about whether 


this is getting the job done, and if need "SY, 
Joshua Peck: For how long? 
MM For 4-6 weeks, but then can reevaluate to see how it's going. 


Frames: 


| | We have 


their messages 


g with CDC pretty regularly, partner on our covid hub, help get 
DC is launching Frames soon. 

Robert: Are you sug g that we run a separate Frames campaign? 

a If you want to run a separate campaign — we consider Frames as a heavyweight signal 
for ranking in feed, to make sure that people see it. We could also do other options, like 
upranking, or prioritizing in feed when a friend adopts it, or quick promotion (like we did with 
election info). For IG, we are strengthening info center, and stickers launching in the next few 
weeks. Frames are unique insofar as it can be used both by Pages and Profiles. Can also do 
bilingual. And can help with design services. 


Robert: My initial instinct is that there should be one frame, and WH is probably not the best 
messenger for that. What are the mechanical differences between this and, say, Pokemon 
Enthusiasts and frames? 
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Real difference is adoption rates, they can do this too. Frames don’t really go viral, you have to 
do the work for adoption. That’s why the partnership web is important. In UK, 2-5% adoption, 
which is reaching 10s of millions. 


Robert: You are suggesting a strategic choice for us — you are not providing a new product. 
Promotions in Feed is extremely valuable. 


ME Yes, quick promotion in feed; then prioritize that the USG Frame is shown to friends of 


people who adopted the frame; also when go to Profile Frames, USG’s is at the top of the 
options. 


Robert: This is different from what you would normally do for the Cat Fagey subscriber. Like 
with voting? ( ) 
WM Yes, exactly. Design of the OP, I'll have to come back tg yofkon the specifics there. 


Robert: | think the idea of doing a Profile Frame for the CDC is super cool; impact is on how 
much juice you are providing. 


HE Still working with CDC on what theirs will look like. 


HE How would you prefer — CDC, His Qty, 


Robert: | think we should throw all of the money to the CDC and make it a national campaign, 
coalescing around one frame. 


| | We don’t want this t just another frame that will get lost; rather a meaningful step and 
we will put resources behin , and will get you details. 


Robert: That is great, and genuinely exciting. 
Josh: We will coordinate with CDC on our end. 


GE On |G, will be on the spectrum of what you saw for voter registration, reminders; when 
they launch | will send designs over. 


Josh: Frames have incredible potential; but are there other ways to use the algorithm to push 
vaccine-promotion, eg photos of people getting vaccinated? 


HE More to come on that at the meeting we have scheduled for Monday on mis/disinfo. 
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Courtney: If you are seeing themes on mis/disinfo even this week and can send us this week 
that would be extremely helpful. Eg, we are seeing a lot of traffic about how pregnant women 
can't take the vaccine. We are working on this right now. 


WM f you are seeing stuff send it our way because that helps us identify trends on the 
platform; we can chase down with our misinfo teams. 


Robert: | would love to see any kind of data you have on the execution of your policies. [Legal 
note: We should discuss this] 
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(or TT o> com> 
Date: Fri, 12 March 2021 12:01:43 


BCC: 
Subject: HHS Call Notes on Profile Frames 


3/12 Notes on HHS Call on Profile Frames 


Josh isn’t able to join but I'll catch up with him. ‘Ss 
Thanks for the feedback so far, it’s been really helpful. We wanted@"to spend time with 
the group to run through your goals it so we can iterate. eas romour design team is here. 
Want to understand more about the circle v. the crescent before move on. 

To recap — thanks for colors. Curious about data on gender bias. We'll defer to you, 
open to crescent. Want to make sure that direction incorporates our design. The text and color 
palette. I'm confident we can come to a good decision. 
fo We’re open to playing with the style of the frame, not married to full circular frame. Want 
to keep with elements of visual brand, we he this. Want the colors, style of the font and the 


map are aligned. We have different map o we sent over punch out. We do have solid 
color map options. We can have design team Share logos and colors. We’re open to not being 
the full circle. Want to tie into “We can do this” campaign — it will tie into ads, on billboards, at 
bus stops, in tv commercials. That's what we want to build recoginition around. 

You were right, the colors and type face were different, should be an easy fix to align 
them. We gave you white wi ack text and logo as a badge. Did anything else stand out as 
off-brand? ( ; 

We do have different black and white elements, have considered it. There are black and 
white components. We made some changes to style guide. We have a separate black and 
white version. We focused more on colors for digital, black and white for print. | can take a look 
back at that. 
| have a question about why to have the text in black and white? 

A few reasons — 

Allow badge to stand forward — users are used to seeing these on FB, Twitter, LinkedIN, instant 
recognition — because they aren’t the same color, it lets the badge stand forward 

Want these to stand out against full circle frames so more universally recognizable 


Is it a matter of black and white text? 

a. could try and achieve with color and white text. But these are often seen at small 
sizes 

HE We want to have the contrast but want the text branding to align 
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| | My priority is consistency with the rest of the campaign — with a complementary color, 
black and white. I’m open to sharing files to help you design, | We're here to work with 
you. If helpful to connect with one of our designers, we can. 

HE Brand guidelines would be really helpful. Would be straightforward to send a tuned up 
version of black and white. Bigger deviations we can do some more back and forth. 

My screenshare isn’t working 

| think we’re good 

| agree with J we've had the conversation we need to have — Mj our style 
guide is not finalized, | will have to check about what we can share — we can share fonts and 


colors 


Wanted to clarify a couple of other things 
Wasn’t clear on copy recommendation — | like it but want to confirm what you meant 
Our frames said | got vaccinated for COVID 19, you suggested | got "SC vaccine — | 


like that personalization — is that the recommendation? 

Yes. You also had a second one “I’m getting my COVID-19 vageine” 
Was the second part of recommendation — can we still have “I’m getting” 
you can — the second one is a little longer — we might have some suggestions — “Let’s get 
vaccinated” — that has really resonated in early qualitative research with users — we’re happy to 
send those as a follow up. J anything else to add? 


In addition to sign — can give people that aren’t able to get vaccine a way to participate 
| love that — | like how succinct | ve. is. The two options sound good- can 


you send both options to run by Josh? 
When we send over designs, we can includé both of them 
| did want to also ask about stickers on Instagram? 
| think you asked for stickers and effects? We're collecting all the information. | work on 
the main FB app. With next iteration can respond on that. 
HE One general questi timeline — want to meet your deadlines. When do we need to 
have that wrapped? 
EE | would like to but I can’t give a definitive date. Let's plan for very early next week. 
When | have a more definitive date, | will let you know. 
We'll try to be wrapped by Monday. 
By Monday would be great. 
Did you get questions on language? 
You told us English/Spanish, phasing the rest in. That sounds good. 
We'll follow up with you on the others but can work immediately on Spanish. 
I’m going to decouple the email, start a new thread on press opportunities, that’s 
another set of our colleagues. 
fee in terms of next steps -ia will align suggestions with typeface and colors. We'll try to 
have in English and Spanish. Let’s see if we can align there. If needed, we can sync with 
designers. 
Do you want me to set a call just in case we need? 

Why don’t we wait until you send us the options? So you'll send us black and white 

and colors? 
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we only have the three colors so that’s the one limiting factor. 
Need 48 hours to upload the frames so we can set upranking and promotions 
That’s really important — good to know — the date we’re aiming for is not Monday 
— black and white — we’ll just update the font and color should be easy — looking at color 
options, a needs the colors from brand guidelines — photo itself influence experience of 
frames — we try and put on a variety of photos — the best way we look at it — put on small feed 
— that makes a lot of sense. One last question — | remember a comment on the 
outline of the map in the badge. You filled the map in, that felt off brand. 
GE We had a different style of map. We do have versions of the map where it’s a solid 
color. That’s just how it had been filled in felt off brand. Now that you have the source files, will 
sync with [I on what | can send with colors. With any questions, you can reach out via 
email if there is anything you need. 
| The reason for the fill was for reading at small scale. If way to CG) that’s more on 


brand, let us know. 


Any last questions? 
not on my end. We'll see what we can send you mre Look forward to what 


you send back. 


Associate General Counsel 


facebook legal 
575 7th Street NW | Washington, DC | 2000 , 


| 
ES 2 co EO com 


{signature_1833550572} 


NOTICE: This email (including any attachments) may contain information that is private, 
confidential, or protected by attorney-client or other privilege. Unless you are the intended 
recipient, you may not use, copy, or retransmit the email or its contents. 
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For i Of> com 
Date: Thu, 18 February 2021 12:32:09 

1: ES 01> corn>; I o.com 
CC: 

BCC: 

Subject: CDC Call Read Out - AC PRIV 


Here are my rough notes: 
Any Issues? 


CDC: Apparently we have a food-borne outbreak, tied to some cows being sold on FB Groups 


— how to report this up? 
HE Poor quality or counterfeit products, | work on those issugs — Q send me the link 
and we can look into it. We have a commodity team that can look ito the source of the cows. 


KRREERERERERERERERERE 


Frames: 


GE Exciting product, lots of leadership Re momentum behind getting public and 


government to use these; so many people o d conversations with family and friends to 
promote vaccinations. Time-sensitive to 


Really responds to the urgency of the moment, to address vaccine-hesitancy 
together. Different governments and NGO (eg, UNICEF )efforts/campaigns on FB to share when 
people get vaccinated, prorgétés; peer-to-peer, so really effective way to reach hard-to-reach 
communities. NHS going haut h a campaign soon, “I got my covid vaccine/I intend to get my 
vaccine.” Using influencers to promote. Moment to launch here in the US, especially in the 
next few months as we shift from demand constraints to hesitancy. We have had success with 
CDC in the past to help change attitudes. Wanted to bring to you right away to explore whether 
this is something you want to work on with us. 


ME This is an easy lift for CDC — you are just uploading a profile frame to your official 
account and it takes off from there. 


CDC: Would be great to leverage what you have. This is really great timing for everyone, it’s a 
great idea to move forward — we have been exploring that internally to go with our “??” 
campaign. Something general that other organizations to promote would be great. 


«We can work with you on easy-lift options 
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CDC: Is there a launch date when you want to kick this off? 


MM ASAP - because it's so easy and we are launching in UK, real issue is how fast you 
guys can move. 


CDC: | think we can do this without any other approval. Whatever you are posting, we can look 
and see how we can promote/share with our partners. Send us an email and we can look at it, 
maybe move into a post as well. 


EE We will send an email that you can share with partners. 


CDC: We love the mock ups, but some feedback, maybe “I got the Covidevaccine” not just “I’m 
vaccinated” 


etl We've love your feedback about what would resonate, ple email me your ideas and 
we'll send to our Product team. 


KRRERKERRREKERREREREKRERE 


Guides: 


ME We have made some moroverents yt i will break less and very easy for you to 
navigate. Launched as “learning units” last yeav/an easy way to organize info my topic and 


organized towards how people learn content. Helps increase brand awareness and content 
marketing. Basically a learning module — quizzes, polls. [walks through slides to show how to 
use]. Lots of new enhancements, eg preview and draft modes. 


CDC: Would this be snareKo )eusteea? 

ME They exist in Pages feed and Newsfeed. 

CDC: Would there still be impressions and other accountable metrics. 

i Yes. 

CDC: Because we have a lot of updates to our content, how would that work? 


a The feed-ranking model has a lot of different variables, not sure if the edited version would 
be bumped up again, but you could share it again on your timeline. 
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CDC: There are no time-stamps on the models you sent, and we are concerned about timely 
updates. 


We will have to verify, but | think we do show timestamps for individual posts in the Guides, 
but I'll follow up. 


MM Can get you those answers asap; but we are going to launch this new product in a few 
months, so have time to work together on this. 


© 
eS 
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6/10 Call with CDC 


TE — two quick things: (1) JJ is going to lead around 70% goal; (2) item from fj on 
the ads side. 

— just wanted to check in Carol on what your team will be doing in the next few weeks 
before July 4 deadline, how we can be helpful, engage with COVID Community Corps. 
Carol — thanks, P| let me know you were interested. We are following the lead of 
HHS/WH. | take it they haven’t made direct asks? 


— right 
ee. — we are in touch with them on CCC. But we always want to check with CDC since you 
sometimes split projects. 
em — right. We don’t have any firm asks from them. | want to make sure that wider 
distribution of who you are engaging, can we help with partnerships, content. We do have a few 
things in the hopper that will be launching. Want to make sure we’re elgng deacie in mind. 
Carol — obviously anything you’re doing to promo vacicnations would be derful. HHS taking 
the lead, we’re sharing their materials on our channels. | understan@that they are working with 
influencers, they have a bus tour going on. | don’t want to step omwhat they are doing, we want 
to act as amplifiers. No one has told me anything about it. Jay, anything to add. 
Jay — we're in the same boat. 
Carol — I'll ask around more. Some of the other platforms are doing their own thing in the spirit 
of it. Google has a link to vaccines.gov on home page. 
WE — we have a few things in the hopper I'pbe very excited to talk about. We are adding 
1-800 number to CIC, PM was on PTO, ba ah up. Several videos from HHS we are 
targeting to low vax uptake communities using SVI. 
Carol — yay, that'll be great. Appreciate you asking. Wish | had a better ask. 


— going to turn it over to J on ads. 

- to talk to you guys. Quick follow up Q on case study for Ad Council. It sounds like 
in speaking to the Ad Coungf t their team got appropriate approvals to move forward and get 
it published. Wanted to cn it you on any guidance. 
Carol — | saw it, hoping Lou will answer it. I'll just write back that it’s fine so you have it on the 
record. Sorry about that. 

— No, it’s ok. Thanks so much. Excited to publish it. 
Carol — It is exciting. Jay had a couple updates on Ads. 
Jay — we've got several ads that will be coming FB’s way for review to start adding into newer 
ad account. Wanted to give you a heads up, a lot coming your way very soon. 
a — great, keep me posted. Feel free to email me if you have any questions. Generally 
speaking, any questions on ad credits, spending, process, keep me posted. | know the amount 
we issued was significantly higher, want to make sure you’re comfortable, able to take 
advantage as much as possible. 
Jay — part of what we do, proposed ad spend. Can you let us know if we should be spending 
more? 
eas — send through what you’re thinking. We'll look and see if it would be pacing correctly 
based on expiration dates. We can always do a separate call if we need to. 
Carol — | Know we pulled some of the numbers on earlier spend 
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Hl — is this content you're working on with Code 3? 

Jay — some of it is, some of it is stuff where we've tried to follow their guidance. 

Carol — | will say, we’ve been pickier about when to use Code 3. We're working with external 
PR companies rather than internal teams. Code 3 liked some of the stuff we’ve sent them. 


Wl — Great — Code 3 can also advise on media strategy, how you're thinking about it from 
media standpoint 


Carol — we'll do that, | don’t think we’ve taken advantage of that yet. 
— if we want to do another call with your team and Code 3, we can always do that. 


Carol — | don’t think we need one, they've been so responsive. We just need to send them 
media plans. 


— ok great, sounds good. Here to support in any way | can. 
— unless any other items, we can wrap up. Thanks! 


© 
eS 
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Exhibit 7 


Email correspondence between 
Facebook, Surgeon General’s office, and 
the White House 


177 


From: I «= 1 er ceBo0K/0U=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLTVCN=RECIPIENTS/CN= {iii 3 F > 


To: Flaherty, Robert EOP/WHO 

ce: Humphrey. Clarke EOP/WHO- Rowe. Courtney M. EOP/WHO; Peck, Joshua (HHS/ASPA): 
Sent: 2/24/2021 5:48:20 PM 

Subject: Re: [EXTERNAL] Misinfo Themes 


Hoping to cover a lot of that Monday—sizll working on data we can share, etc 


Can definitely go into detail on content that doesn’t violate like below but could contribute to vaccine hesitancy. 


facebook, inc. | politics & government 
| BEE 212 com 


On Feb 24, 2021, at 8:41 PM, Flaherty, Robert EOP/WHO <6 vh.0.cop.gov> wrote: 


Awesome. This ts helpful. Can you give us a sense of volume on these, and some metrics around rhe scale of 
removal for each? 


Can you also give us a sense of misinformation that might be falling outside of your removal policies? 


Goes without saying, Just because it’s on your list for removal hasn't historically meant that it was removed, so I 
want to get a sense of the state of play here! 


Thanks, all. 


Sent from my iPhone 
On Feb 24, 2021, at 7:54 PM i 7? fb com> wrote: 


Hi all, 


Following up on your request for COVID-19 misinfo themes we are seeing. All the below claims viclate our 


updated Covid and vaccine misinformation policies that we announced earlier this month, and we are removing 
these claims from our platforms: 


Theme 1: Vaccine Toxicity: Claims that the vaccine contains aborted fetal tissue, has microchips embedded in it, 
toxic levels of aluminum, ete. 


Theme 2: False Claims About Side Effects of Vaccine: Claims that vaccines will cause autism, the vaccine 
changes DNA, causes infertility, etc. 


Theme 3: Comparing the Covid Vaccine to the Flu Vaccine: That you are more likely to die after the COVID 
vaccine than after the flu vaccine. 


Theme 4: Downplaying Severity of COVID-19: Claims that COVID-19 is a hoax, not any worse than the flu, etc. 
Looking forward to continuing this conversation on Monday. 


Best, 
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st inc. 


olitics & government 
TOY 
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Exhibit 8 


Internal Facebook email 
correspondence 
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</O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 


From: 


/CN=70251C0920BB487E8111461E3692A624> 
To: 
Sent: 3/2/2021 7:34:03 PM 
Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


Thanks for this. Think we’re getting closer to where we need to be. 


From: @fb.com> 

Date: Tuesday, March 2, 2021 at 10:38 AM 

To: @fb.com> 

Subject: Fwd: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Fwiw, we're trying to push DS on this... See below. 


From: fb.com> 
Sent: Tuesday, March 2, 2021 09:35 

To: 
Cc: 


Subject: Fwd: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


Hey GJ see below. It looks like this is getting out of hand :/. Do you have a good sense of what the WH 
wants? Would it make sense for you to huddle w/ Pravin (and maybe others) this morning to come up with some 
creative solutions? 


From: i BO fb.com> 
Sent: Tuesday, March 2, 2021 09:18 


ee ee es 
Cc: 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 
-some folks 


Cedric Richmond (Head of the White House Office of Public Engagement) reached out to us last night with 
feedback that the White house was frustrated by yesterday’s meeting, particularly around the information we are 
providing on our enforcement efforts. Hoping that we can drive to two conclusions during the day today: 1) walk 
back from language referring to any “lockdown” by providing broader context around our internal work; 2) 
determine what we can deliver to the WH in order to be viewed as a trusted, transparent partner around efforts to 
curb misinformation. 


| Know we have a meeting scheduled for late afternoon—! wanted this group to have the additional context that we 
are hearing from Senior WH leadership that they are running out of patience with us on this subject, and it may cost 
us an opportunity to work with them constructively. 


From: i EEO! com> 


Date: Monday, March 1, 2021 at 11:40 PM 


To: fb.com>, @fb.com>, 
@fb.com>, @fb.com>, @fb.com>, Iii 
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Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Just confirming we'll obviously hold on any follow up communication until we can have this meeting and settle ona 
response. 


From: i <GB ofb.com> 


aa Monday, March 1, 2021 at 11:04 PM 


@fb.com>, EDs com>, 
@fb.com>, @fb.com>, @fb.com> 


@fb.com>, {RO fb.com>. 


@fb.com> 
Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Thanks team. When we are going back to the White House? Guy and | would like to meet to discuss our response 
before we do. | realize now that the point about the lockdown was mentioned in the talking points that ii sent 
around on Sunday, but it probably wasn't the right call to include that in the first place (my bad for not seeing it on 
Sunday) because it’s so hard to set appropriate context around such an effort and not have it look like too little, too 
late. | think that we should proceed with a lot of caution and de-emphasize the lockdown. | would not provide a 
senior member of the integrity team to brief about it specifically. 


K can you please schedule, ideally for tomorrow? Can include everyone on this thread (but ii 
and can probably be optional if they prefer). 


From: i PE o> com> 


Date: Monday, March 1, 2021 at 7:12 PM 


HB Oib.com>, 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Thanks all. A quick recap of the action items / owners: 


182 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0059827 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


te aa is working on a proposal for comment about the lockdown 

2. We have time with the data transparency team to talk through what (if anything) is possible to share on 
demographic / language breakdown 

3. We are working with i on Crowdtangle approval 

4. (outside of the requests from the WH) We are working to set up a meeting with DS and data transparency 
to level set on what misinfo data we already collect and what we could start to work towards sharing externally 
to avoid the reactive requests we have been getting. | will help document the overall plan/process for this. 


From: ES GEE @'b.com> 


Date: Monday, March 1, 2021 at 9:51 PM 


To: EE Of com>, TE <EO'>.con>, 
@fb.com> 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


+ ( who is POC for the COVID Defense lockdown and has the latest on specific lockdown goals 
and current progress. He should closely review anything we plan to send to ensure accuracy. 


From: fb.com> 
aie Monday, March 1, 2021 18:47 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


+@ EE 0n the lockdown objectives proposed response. 


From: TS EEO com> 


co Monday, March 1, 2021 at 6:45 PM 


gh {EE Of .com> 


| GB Of. com>, 


@fb.com> 
Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


They're looking for Spanish vs English in the US and my sense is they’re looking mainly for race. Would you agree 
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to that assessment 


facebook, inc. | politics & government 


On Mar 1, 2021, at 9:41 PM, i <I @ fb.com> wrote: 


Thanks for the update = Reg Ask 2 “Provide Demographic and Language Breakdown of Misinformation / 
Enforcement’, could you share any context on why they are interested in language and demographic breakdown 
specifically? E.g. wrt language, are they interested enforcements globally or just US, and if global, why? 

Any additional context will be really helpful. 


From: SE EEE O>.com> 


Date: Monday, March 1, 2021 at 6:27 PM 


fB Ofb.com>, 
<carlsonlieber@fb.com> 
Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Hi all, 


We wanted to share an update from today’s White House meeting on Covid misinformation. Overall, the meeting 
went relatively well and our presenters did a great job delivering our message to a skeptical audience. Notably, in 
addition to expected participants (White House Digital Director Rob Flaherty and others on the WH and HHS 
public engagement teams), Senior Covid Advisor Andy Slavitt joined the call. Slavitt was head of Medicare and 
Medicaid Services under President Obama and is leading private sector engagement for the Covid Task Force. 
Slavitt’s participation is a good indication of the level of importance with which the White House views our 
handling of Covid misinformation. 


While Facebook teams provided ample explanations of our offensive work / approach to authoritative 
information, there is still skepticism about our ability to address misinformation, and clear frustration that we 
aren’t able to provide more data that demonstrates our work in this area. 


Specific Asks from the White House: 


1. Provide Details on Lockdown - They wanted to better understand what is happening in our lockdown, 
what outcomes we are optimizing for, and specifically how far along we are and whether we are waiting until 
completion of the work to implement our findings. 

2. Provide Demographic and Language Breakdown of Misinformation / Enforcement - They requested 
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any data we have on demographic and language breakdowns on vaccine hesitancy content and 
misinformation more broadly. Ideally, they would like claim level data. We will work with Data Transparency 
to understand what (if anything) is possible to share. 

3. Explore CrowdTangle partnership offer and insights - They were especially positive and interested in 
exploring this and learning how CDC has used it with our partnership - the CT team is moving forward with 
exploring how this could work for the WH Covid-19 Task Force and gaining necessary approvals. 


For #1, we would like to quickly respond with some clarifying information this evening if possible, and we believe 
that offering a briefing on this work will also help to steady their impression of our approach. Based on Andy 
Slavitt’s engagement, we believe a senior integrity team member should brief the White House team on the 
lockdown as a next step. If others agree on this approach, below is proposed language that we plan to ahare back 
tonight if possible: 


ok ok ok 
Our lockdown is focused on: 


1. Improving the effectiveness of our enforcement 

2. Reducing virality of content that could lead to hesitancy around the vaccine 

3. Ensuring our amplification systems (e.g. recommendations; top comments) and discovery surfaces (e.g. 
search) do not inadvertently push vaccine hesitancy content or entities to people and instead amplify 
authoritative information 


We are about halfway through the lockdown, which is iterative and we are implementing solutions as we 
progress. We'd be happy to schedule a follow discussion to provide additional information on this work. 


Based on what we are hearing through other channels, we expect that the White House plans to establish a cross- 
industry social media task force with the goal of setting a baseline on Covid misinformation and enforcement. We 
expect an announcement within the next two weeks. 


Looking forward to your feedback on the lockdown note as well as if we are amenable to a briefing on the 
lockdown. 


From: iS {EE of com> 


Date: Sunday, February 28, 2021 at 3:43 PM 


To: fb.com>, 
@fb.com>, 
Ce: i 


@fb.com>, 


on 


{ @fb.com>, 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


{EB Ofb.com>, 
@fb.com>, @fb.com> 


Thanks all. We are confident that we have enough prepared in terms of substance and new information on our 
enforcement to keep the meeting tomorrow—this additional stat would have been helpful because it is directly 
responsive to a question that came from the White House about the trends that we shared but it’s not essential to 
have cleared in order to have the meeting. The original intent of the meeting was not driven by this specific piece 
of data. 
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We're also confident that we have the right team prepared to meet on Monday—the folks on the call are prepared 
to cover the material and are “seasoned pros” with this difficult audience, so no need to add anyone from DS to 
assist. 


We will work to reframe around offering access to CrowdTangle as an option going forward, and it will also be 
helpful to say that we are working to confirm a response to the question on prevalence around the themes, and that 
we'd like to continue to field questions from them to help them better understand the discourse around the vaccine, 
and we will work to get them helpful answers. And we'll of course make sure to work through Stat review process 
going forward. 


Let me know if there are any other concerns—thanks for everyone's quick responses on a Sunday. 


From: @fb.com> 
Date: Sunday, February 28, 2021 at 3:30 PM 


To). 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


It seems the request came in "this week" after we met with them on Tuesday the 23rd, and also after we replied 
with the theme categories in response to Tuesday's meeting. So! don't think it's reasonable to have this fast a turn 
around”. So | agree with i here we are setting ourselves up to fail a bit with the immediate turnaround time, 
"Option D: we are working on a more detailed understanding of sub-categorizing, but to the best of our 
understanding so far theme 4 is the most frequent.” 


Agree with i point these were framed as prevalence metrics when they are not. I'm also confused about 
how we are making claims about top items but only with 65% cumulative total, yet have one theme at 1% and one 
theme at 5%. That has red flag written on it to me, and should give pause to anyone reading the option A in 
reference to the "top" themes. Lastly unknown on the accuracy here or even how to properly caveat (primarily in 
part because there's been no time to review, although we have a thread trying to understand now). 


Love [J point on bringing them the content. 


*I've noticed a consistent pattern with content violations that we often want categorization of content 
actioned in our polocy and comms discussions, yet we don't put in the effort to label these things 
upfront or build this into our internal operations. | think if we want to be able to refer to sub policy 
categorization, we should approach this in a proactive not a reactive way. 


From: is EB @fb.com> 
Sent: Sunday, February 28, 2021, 12:01 PM 


) aes (aes eee 
= Cl ll 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 
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Also adding in response from earlier today, thread split. Basically I’m asking if we can tell them in advance 
that we are prepared for #2 tomorrow, and we believe that we can make valuable progress, but that unfortunately 
we need more time to give them accurate data for #1. 


Based on the metrics escalation on Friday, the breakdown of claims was from "some arbitrary queries some DS 
ran without any context" - this stuff is valuable but we need it to be done right so that we share stats that are 
accurate and not rush something that ends up being simply wrong. There does seem to be a process breakdown 
here, I'm not exactly sure where as ae & | were only on the tail end of it. Rather than last minute try to approve 
bad stats, we need to ensure this is coordinated well in advance so that the work can be done. 


Stepping back, are there two different things the WH might be trying to do, based on the questions being asked 
(credit to [J for the framework): 

1/ Holding us accountable for our execution on misinfo 

2/ Understanding what the discourse is about the vaccine 


#1 is always going to be an uphill battle, we will not be perfect and any miss will be amplified. 

The breakdown question seems to hint they are interested in #2 as well. Should we lean in more in order to reframe 
this to #2, for example offering CrowdTangle dashboards (like we did for Secretaries of State for voting; | believe 
we've given the WHO a dashboard like this). We can make ourselves a helpful partner as they seek to understand 
what people are saying. 


From: iS @1) com> 


Date: Sunday, February 28, 2021 at 11:59 AM 


To: © co OD com>, 
I Ofb.com>, 


@fb.com> 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Is it an option to delay/reset expectations for the meeting? It seems like we set expectations on February 23 that 
we’d come back with this data on March 1 — sounds like we got a little ahead of ourselves. I. | wonder if we 
should tell them that we think it’s valuable for us to meet to discuss the substantive themes so that we can make 
progress on the authoritative information side, but that we’re still working through data accuracy issues — so we 
can't really have the data-based conversation tomorrow. | know that's not ideal (and we'll debrief on my side to 
make sure that we don't end up in this spot on the eve of meetings in the future), but | wonder if that’s better than 
either putting ourselves in an uncomfortable spot on data or making them angry by seeming to waste their time. 


From: EEE 10.com> 


Date: Sunday, February 28, 2021 at 11:56 AM 


EE > com> I "com 
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@fb.com>, 
fb.com>, 


{I fb.com>, 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


@fb.com>, 


Hi all, 


As aa and | shared last week, unfortunately, we are not supportive of sharing these percentage 
breakdowns: 
e These are not prevalence estimates and should not be described as such. These are based on 
content we enforced. 
e We do not have standard categorization of claims into themes through manual review or 
classifiers. The data is not logged by theme. 
For context, these were obtained from an IC in LON, outside of our normal Data Transparency 
process. 


The risk of sharing exact percentages is undermining the credibility of other numbers we share. 


The alternative is sharing that these are examples of top themes across the M&H content we found 
and enforced on. We discussed potentially describing our banking process to highlight how we 
cluster and fan out on content - a process that gives us scale, but does not yield exact sizing of 
themes. 


From: fb.com> 
Sent: Sunday, February 28, 2021 11:20 AM 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


| think we're aligned on the comms side that Option A (with the caveats) is the best approach to attempt to avoid a 
public spat with the administration. And gives us best response should they leak it, something like: “cooperating 
with WH, these are only rough estimates, we have initiated a work-stream that’s showing results” 


On Feb 28, 2021, at 10:50 AM, i) §@fb.com> wrote: 


| defer to others on what metrics and data can/should be shared, but two flags — 

(1) we aren't currently removing claims that the vaccine contains aborted fetal tissue — | asked on Friday for more 
follow up on the imminent physical harm assessment (which the CDC can provide), but that claim isn’t on our 
remove list yet, so hopefully we didn't tell anyone that we are removing it. 
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(2) Are we sending the right people to this meeting? If VWH wants to talk about data & metrics and not policy, it 
seems like we’re setting ourselves up for trouble by sending only policy people. 


From: fb.com> 


Sent: Sunday, February 28, 2021 8:07 AM 


Subject: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


Good morning—apologies for the Sunday email—we are working to resolve a question around what information 
we can share in a Covid misinformation briefing with the White House scheduled for tomorrow. Hoping to get 
further guidance. Details below, thanks for your attention. 


The White House asked us for a meeting to specifically discuss our metrics and data on COVID-19 
misinformation which will be held on March | at 3pm EST. Feedback from the WH in our last meeting with them 
on Feb 23rd was that they want to see the following information; 


1. Top themes we are seeing around Covid-19 misinfo and how it is manifesting on our platform 
2. Granular insight into data that we have that can speak to our execution of our misinfo guidelines 
3. Our approach to sharing authoritative information 

4. Info on misinfo take downs and enforcement 

5. Our approach on content we don’t remove 


They gave us tough feedback that they don’t want to hear our normal policy overview and that if we are unable 
to provide more granular information around what we are seeing on the platform as well as our work to enforce 
our policies, it will be viewed as a disappointment. 


This week we sent them a list of recent themes that we see on our platform that we are removing: 


Theme 1: Vaccine Toxicity: Claims that the vaccine contains aborted fetal tissue, has microchips embedded in it, 
toxic levels of aluminum, etc. 


Theme 2: False Claims About Side Effects of Vaccine: Claims that vaccines will cause autism, the vaccine 
changes DNA, causes infertility, etc. 


Theme 3: Comparing the Covid Vaccine to the Flu Vaccine: That you are more likely to die after the COVID 
vaccine than after the flu vaccine. 


Theme 4: Downplaying Severity of COVID-19: Claims that COVID-19 is a hoax, not any worse than the flu, 
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etc. 


They responded positively but asked as follow up: “Can vou give us a sense of volume on these, and some 
metrics around the scale of removal for each?” 


They have a strong perception that we are not doing enough, and we want to respond to their clear requests when 
we can, 


We do have a general percentage breakdown of these themes against overall COVID violations but it has not 
cleared STAT review: 


Theme |: Vaccine Toxicity: 15% of all COVID Violations. 
Theme 2: False Claims About Side Effects of Vaccine: 3-5% of all COVID violations. 
Theme 3: Comparing the Covid Vaccine to the Flu Vaccine: 1% of all COVID violations 


Theme 4: Downplaying Severity of COVID-19: Totals to ~45% of all COVID violations. 


These percentages were not able to go through Stat review and we understand they were not approved to share, 
but we are flagging that we believe sharing some breakdown for prevalence of these four themes will help to 
build credibility with this hostile audience, by responding directly to a question about the four themes. We would 
of course offer a caveat that these are rough estimates and only based on trends we are seeing from the last few 
weeks. 


While the percentages don’t answer the exact question posed by the White House team, they at least demonstrate 
some commitment on our end to meet their request. Moving forward, we do think it is important to start to share 
more information with them that will be helpful and we will work with the Data Transparency team to determine 
what can be shared on an ongoing basis that is more specific to their needs. 


For decision: 


Option A: Share these as rough percentages verbally and explain these are new stats that are not public and not 
to be shared, For example, /he claims around COVID-19 are quite dynamic given that the information we have 
is evolving rapidly, however, our preliminary look at recent data shows that approximately 45 percent of the 
coment on our platforms falls into the general category of downplaying the severity of the COVID-19 disease. 
including claims that no one has died from coronavirus or that the death toll is much lower than official 
figures. Approximately 13 percent of the recent claims deal with vaccine toxicity, including claims that the 
vaccines contain harmful ingredients or microchips, False claims about COVID-19 vaccine side-effects and 
claims comparing the COVID-19 vaccine to the flu vaccine account for approximately 3 percent and I percent 
of claims on our platforms respectively. 
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Option B: Discuss these themes in more relative terms. For example, we could say “Zheme 4 accounts for close 
to half of the violations, followed by Theme 1. We see Theme 2 and 3 with less frequency.” Or “The vast 
majority of these claims are Theme 4, followed by Themes 1, 2, and 3 in that order.” Or perhaps re rank them in 
order of prevalence 


Option C: Say that we do not share this type of data. 


won't get through all of the content included here, but we plan for this to be an ongoing discussion around our 
work to curb Covid misinformation on the platform. 


Happy to organize a quick call Monday morning to discuss as well—as mentioned above the briefing is scheduled 
for 3:00 ET, and our team has scheduled a final walk through for 1:00 ET. 


Thanks, 
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Exhibit 9 


Internal Facebook email 
correspondence 
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From: /O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=B73E73BCAEC04FA7972116B731F6EB67> 

To: 

Cc: 

Sent: 3/2/2021 8:22:59 AM 

Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


Thanks. ja In light of Ps email below. if you feel like you’d benefit from more guidance on what the WH 
wants or would be satisfied with, it might make sense to ping and see if he'd like to join that meeting, 


From: fb.com> 
Sent: Tuesday, March 2, 2021 10:04:38 AM 
To: fb.com> 


Ce: @'> com> TE © (> con>; i 6 (5 com> 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


Thanks mz. I'll see if | can move this along on our end... | have an XFN with (of = re: Si 10a PT 
where we were going to discuss broader long-term misinfo transparency reporting strategy, but in light of these 
developments we'll of course prioritize our focus on the current WH-specific concerns first. 


From: fb.com> 
Date: Tuesday, March 2, 2021 at 10:35 AM 


To: EE 2 fb.com> 
Ce: fo.com>, i ©'>.com>, Zi 
fb.com> 


Subject: Fwd: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Hey see below. It looks like this is getting out of hand :/, Do you have a good sense of what the WH 
wants? VWoud it make sense for you to huddle w/ HE (and maybe others) this morning to come up with some 
creative solutions? 


From: @fb.com> 
Sent: Tuesday, March 2, 2021 09:18 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


-some folks 


(Head of the White House Cffice of Public Engagement) reached out to us last night with 
feedback that the White house was frustrated by yesterday’s meeting, particularly around the information we are 
providing on our enforcement efforts. Hoping that we can drive to two conclusions during the day today: 1} walk 
Dack from language referring fo any “lockdowr’ by providing broader context around our internal work; 2) 
determine what we can deliver to the VVH in order to be viewed as a trusted, transparent partner around efforts to 
curb misinformation. 


| know we have a meeting scheduled for late afternoon—! wanted this group to have the additional context that we 
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are hearing from Senior WH leadership that they are running out of patience with us on this subject, and it may cost 
us an Opportunity to work with them constructively. 


From: iE tp .com> 


Date: Monday, March 1, 2021 at 11:40 PM 


@fb.com->, @fb.com>, = 
@fb. @fb.com>, 
Gf. com>, fb.com> Joel 


Dfb.com> 


Subject: Re: FOR DECISION: White House Recuest on Covid Vaccine Misinfo Themes and 
Prevalence 


Just confirming we'll obviously hold on any follow up communication until we can have this meeting and settle ona 
response. 


From: Si fb.com> 


Date: Monday, March 1, 2021 at 11:04 PM 


To: fb. ' 
Mtb.com>, Mib.com>, fo.com> 
fb.com>, 


Subject: Re: FOR DECISION: White House Recuest on Covid Vaccine Misinfo Themes and 
Prevalence 


Thanks team. When we are going back to the White House? WB anc | would like to meet to discuss our response 
before we do. | realize now that the point about the lockdown was mentioned in the talking points that sent 
around on Sunday, but it probably wasn't the right call to include that in the first place {my bad for not seeing it on 
Sunday} because it’s so hard to set appropriate context around such an effort and not have it look like too little, too 
late. | think that we should proceed with a lot of caution and de-emphasize the lockdown. | would not provide a 
senior member of the integrity team to brief about it specifically. 


HE Can you please schedule, ideally for tomorrow? Can include everyone on this thread (but Joel 
and [can probably be optional if they prefer). 


From: is fb.com> 


Date: Monday, March 1, 2021 at 7:12 PM 


To: fb.com> 
BR fb com>, 
Ce: 


Mm) fb.com>, 
BE fb. com>,  @fb.com>, Dib.com>, Joel Kaplan 
LS: o> To o>, NST con, 
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fo.com>, a’ 


fb.com>, 


Subject: Re: FOR DECISION: White House Reauest on Covid Vaccine Misinfo Themes and 
Prevalence 


Thanks all. A quick recap of the action items / owners: 


1. Eis working on a proposal for comment about the lockdown 

2. We have time with the data transparency team to tak through what (if anything} is possible to share on 
demographic / language breakdown 

3. We are working with i on Crowctangle approval 

4. (outside of the requests from the WH) We are working to set up a meeting with DS and data transparency 
to level set on what misinfo data we already collect and wnat we could start to work towards sharing externally 
to avoid the reactive requests we have been getting. | will help document the overall plan/process for this. 


From: i o f5.com> 


Date: Monday, March 1, 2021 at 9:51 PM 


fo.com>, i: :) con>, 
fb.com>, ii TE {b.com>, 


Dfb. com> 


Subject: Re: FOR DECISION: White House Recuest on Covid Vaccine Misinfo Themes and 
Prevalence 


HI 30 is POC for the COVID Defense lockdown and has the latest on specific lockdown goals 
and current progress. He should closely review anything we plan to send to ensure accuracy. 


From: @fb.com> 


Sent: Monday, March 1, 2021 18:47 
To: poe erst Te 


Ce: 
oel Kaplan; 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


HR 0 thie lockdown objectives proposed response. 
From: i ©!) com> 


Date: Monday, March 1, 2021 at 6:45 PM 


To: IO. com> 
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Subject: Re: FOR DECISION: White House Reauest on Covid Vaccine Misinfo Themes and 
Prevalence 


They're looking for Spanish vs English in the US and my sense is they're looking mainly for race. Would you agree 
to that assessment 


facebook, inc. | politics & government 


On Mar 1, 2021, at 9:41 PM TE com> wrote: 


Thanks for the update I Reg Ask 2 “Provide Demographic and Language Breakdown of Misinformation / 
Enforcement’, could you share any context on why they are interested in language and demographic breakdown 
specifically? E.g. wrt language, are they interested enforcements globally or just US, and if global, why? 

Any additional context will be really helpful. 


From: vfib.com> 
Date: Monday, March 1, 2021 at 6:27 PM 


{> con, J Co'D.com>, 
fo.com>, ES fb .com>, 


Subject: Re: ee DECISION: White House Request on Covid Vaccine Misinfo Themes and 
Prevalence 


Hi all, 


We wanted to share an update from today’s White House meeting on Covid misinformation. Overall, the meeting 
went relatively well and our presenters did a vreat job delivering our message to a skeptical audience. Notably, in 
addition to expected participants (White House Digital Director Rob Flaherty and others on the WH and HHS 
public engagement teams), Sentor Covid Advisor Andy Slavitt joined the call. Slavitt was head of Medicare and 
Medicaid Services under President Obama and is leading private sector engagement for the Covid Task Force. 
Slavitt’s participation 1s a good indication of the level of importance with which the White House views our 
handling of Covid misinformation. 


While Facebook teams provided ample explanations of our offensive work / approach to authoritative 
information, there ts still skepticism about our ability to address misinformation, and clear frustration that we 
aren't able to provide more data that demonstrates our work in this area. 


Specific Asks from the White House: 
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1. Provide Details on Lockdown - They wanted to better understand what is happening in our lockdown, 
what outcomes we are optimizing for. and specifically how far along we are and whether we are waiting until 
completion of the work to implement our findings. 

2. Provide Demographic and Language Breakdown of Misinformation / Enforcement - They requested 
any data we have on demographic and ianguage breakdowns on vaccine hesitancy content and 
misinformation more broadly. Ideaily, they would like claim level data. We will work with Data Transparency 
fo understand what (if anything) is possible to share. 

3. Explore CrowdTangle partnership offer and insights - They were especially positive and interested in 
exploring this and learning how CDC has used it with our partinership - the CT ieam is moving forward with 
exploring how this could work for the WH Covid-19 Task Force and gaining necessary approvais. 


For #1, we would like to quickly respond with some clarifying information this evening if possible, and we believe 
that offering a briefing on this work will elso help to steady their rmpresston of our approach. Based on Andy 
Slavitt’s envavement, we believe a senior integrity team member shauld brief the White House team on the 
lockdown asa next step. If others agree on this approach, below is proposed language that we plan to share back 
tonight if possible 


% RK 


Our lockdovsi is focised on: 


1. improving the effectiveness of our enforcement 

2. Reducing virality of content that could lead to hesitancy around the vaccine 

3. Ensuring our amplification systems (e.g. recommendations; top comments) and discovery surfaces {e.g. 
search) do not inadvertently push vaccine hesitancy content or entities to people and insiead amplify 
authoritative information 


We are about halfway through the lockdown, which ts Herative and we are implenentiig SOlMUORS as Wwe 
progress. We'd be happy to schedule a follow discussion to provide additional information on this work. 


Based on what we are hearing through other channels, we expect that the White House plans to establish a cross- 
industry social media task force with the goal of setting 2 baseline on Covid misinformation and enforcement, We 
expect an announcement within the next two weeks, 


Looking forward to your feedback on the lockdown note as well as if we are amenable to a briefing on the 
lockdown. 


Fron: Sb com> 
Date: Sunday, February 28, 2021 at 3:43 PM 


1): RES fb com>. » con, 
2 fb. com>, fb.com> @fb.com> 


fb.com>, Joel Kaplan fb.com>, 


Subject: Re: FOR DECISION: White House Recuest on Covid Vaccine Misinfo Themes and 
Prevalence 
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Thanks all. We are confident that we have enough prepared in terms of substance and new information on our 
enforcement to keep the meeting tomorrow—this additional stat would have been helpful because it is directly 
responsive to a question that came from the White House about the trends that we shared but it’s not essential to 
have cleared in order to have the meeting. The original intent of the meeting was not driven by this specific piece 
of data. 


We're also confident that we have the right tean prepared to meet on Monday—the folks on the call are prepared 
to cover the material and are “seasoned pros” with this difficult audience, so no need to add anyone from DS to 
assist. 


We will work to reframe around offering access to CrowdTangle as an option going forward, and it will also be 
nelpful to say that we are working to confirm a response to the question on prevalence around the themes, and that 
we'd like to continue to field questions from them to help them better understand the discourse around the vaccine, 
and we will work to get them helpful answers. And we'll of course make sure to work through Stat review process 
going forward. 


Let me know if there are any other concerns—‘hanks for everyone’s quick responses ona Sunday. 


From: iT Sf .com> 

Date: Sunday, February 28, 2021 at 3:30 PM 
To: iE @ fb .com> 
Rib .com>, fb.com> 
Cc: I (>. com> HEE) f>. com>, Joel Kaplan 


fb.com>, Es 


Subject: Re: FOR DECISION: White House Recuest on Covi 
Prevalence 


It seems the request came in “this week" after we met with them on Tuesday the 23rd, and also after we replied 
with the theme categories in response to Tuesday's meeting. So | don't think it's reasonable to have this fast a turn 
around*. So! agree with here we are setting ourselves up to fail a bit with the immediate turnaround time, 
"Option D: we are working on a more detailed understanding of sub-categorizing, but to the best of our 
understanding so far theme 4 is the most frequent." 


Agree with | point these were framed as prevalence metrics when they are not. I'm also confused about 
how we are making claims about top items but only with 65% cumulative total, yet have one theme at 1% and one 
theme at 5%. That has red flag written on it fo me, and should give pause to anyone reading the option A in 
reference to the "top" themes. Lastly unknownon the accuracy here or even how to properly caveat {primarily in 
part because there's been no time to review, although we have a thread trying to understand now). 


Lovefii# point on bringing them the content. 


*I've noticed a consistent pattern with content violations that we often want categorization of content 
actioned in our polocy and comms discussions, yet we don't put in the effort to label these things 
upfront or build this into our internal operations. | think if we want to be able to refer to sub policy 
categorization, we should approach this in a proactive not a reactive way. 


Get Outlook for Android 


From SE 1 .com- 


Sent: Sunday, February 28, 2021, 12:01 PM 
To: pee eee eas esl 
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Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


Also adding in [fs response from earlier today, thread split. Basically I’m asking if we can tell them in advance 
that we are prepared for #2 tomorrow, and we believe that we can make valuable progress, but that unfortunately 
we need more time to give them accurate data for #1. 


Based on the metrics escalation on Friday, the breakdown of claims was from “some arbitrary queries some DS 
ran without any context" - this stuff is valuable but we need it to be done right so that we share stats that are 
accurate and not rush something that ends up being simply wrong. There does seem to be a process breakdown 
here, I'm not exactly sure where as JS | were only on the tail end of it. Rather than last minute try to approve 
pad stats, we need to ensure this is coordinated well in advance so that the work can be done. 


Stepping back, are there two different things the WH might be trying to do, based on the questions being asked 
(credit to for the framework: 

1/ Holding us accountable for our execution on misinfo 

2/ Understanding what the discourse is about the vaccine 


#1 is always going to be an uphill battle, we will not be perfect and any miss will be amplified. 

The breakdown question seems to hint they are interested in #2 as well. Should we lean in more in order to reframe 
this to #2, for example offering CrowdTangle dashboards (like we did for Secretaries of State for voting; | believe 
we've given the WHO a dashboard like this). We can make ourselves a helpful partner as they seek to understand 
what people are saying. 


From: Ofb.com> 
Date: Sunday, February 28, 2021 at 11:59 AM 


10: is (> con>, Eo: oon> 


@fb.com>, Joel Kaplan 


@fb.com>, 


Qfb.com>, 


Subject: Re: FOR DECISION: White House Recuest on Covid Vaccine Misinfo Themes and 
Prevalence 


Is it an option to delay/reset expectations for the meeting? It seems like we set expectations on February 23 that 
we'd come back with this data on March 1 — sounds like we got a little ahead of ourselves. | wonder if we 
should tell them that we think it’s valuable for us to meet to discuss the substantive themes so that we can make 
progress on the authoritative information side, but that we're still working through data accuracy issues — so we 
can't really have the data-based conversation tomorrow. | know that’s not ideal (and we’l debrief on my side to 
make sure that we don't end up in this spot on the eve of meetings in the future), but | wonder if that’s better than 
either putting ourselves in an uncomfortable spot on data or making them angry by seeming to waste their time. 


Fro: a) .com> 
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Date: Sunday, February 28, 2021 at 11:56 AM 


To: © {.con>, IER fb.com> 
Ce: fb. com>, — te come, 


J 
Mfb.com>, 


Subject: Re: FOR DECISION: White House Recuest on Covid Vaccine Misinfo Themes and 
Prevalence 


Hi all, 


As HJ and | shared last week, unfortunately, we are not supportive of sharing these percentage 
oreakdowns: 
e Tnese are not prevalence estimates and should not be described as such. These are based on 
content we enforced. 
e We do not have standard categorization of claims into themes through manual review or 
classifiers. The data is not logged by theme. 
For context, these were obtained from an IC in LON, outside of our normal Data Transparency 
process. 


The risk of sharing exact percentages Is undermining the credibility of other numbers we share. 


The alternative is sharing that these are examples of top themes across the M&H content we found 
and enforced on. We discussed potentially describing our banking process to highlight how we 
cluster and fan out on content - a process thai gives us scale, but does not yield exact sizing of 
themes. 


From: i @fb.com> 
Sent: Sunday, February 28, 2021 11:20 AM 
To: EE fb. com> 
Cc: ES f>.com>; RE > o> op com>. Joel Kaplan 


Subject: Re: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes and Prevalence 


| think we're aligned on the comms side that Option A (with the caveats) is the best approach to attempt to avoid a 
public spat with the administration. And gives Ls best response should they leak it, something like: “cooperating 
with VWH, these are only rough estimates, we have initiated a work-stream that’s showing results” 
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On Feb 28, 2021, at 10:50 AM, I tb.com> wrote: 


| defer to others on what metrics and data cary/should be shared, but two flags — 

(1) we aren’t currently removing claims that the vaccine contains aborted fetal tissue —| asked on Friday for more 
follow up on the imminent physical harm assessment (which the CDC can provide), but that claim isn't on our 
remove list yet, so hopefully we didn't tell anyone that we are removing it. 

(2) Are we sending the right people to this meeting? If WWH wants to talk about data & metrics and not policy, it 
seems like we're setting ourselves up for trouble by sending only policy people. 


From: fb.com> 
Sent: Sunday, February 28, 2021 8:07 AM 
fb.com>: Joel 


Subject: FOR DECISION: White House Request on Covid Vaccine Misinfo Themes ard Prevalence 


Good morning—apologies for the Sunday ematl—we are working to resolve a question around what information 
we can share in a Cavid misinformation briefing with the White House scheduled for tomorrow. Hoping to get 
further guidance. Details below, thanks for your attention. 


The White House asked us for a meeting to specifically discuss our metrics and data on COVID-19 
misinformation which will be held on March | at 3pm EST. Feedback from the WH in our last meeting with them 
on Feb 23rd was that they want to see the following information: 


1. Top themes we are seeing around Covid-49 misinfo and how it is manifesting on our platform 
2. Granular insight into data that we have that can speak to our execution of our misinfo guidelines 
3. Our approach to sharing authoritative information 

4. Info on misinfo take downs and enforcement 

5. Our approach on content we don’t remove 


They gave us tough feedback that they don’t want to hear our normal policy overview and that 1f we are unable 
to provide more granular information around what we are seeing on the platform as well as our work to enforce 
our policies, it will be viewed as a disappointment. 


This week we sent them a list of recent themes that we see on our platform that we are removing: 


Theme |: Vaccine Toxicity: Claims that the vaccine contains aborted fetal tissue, has microchtps embedded in it, 
toxic levels of aluminum, ete. 


Theme 2: False Claims About Side Effects of Vaccine: Claims that vaccines will cause autism, the vaccine 
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changes DNA, causes infertility, ete. 


Theme 3: Comparing the Covid Vaccine to the Flu Vaccine: That you are more likely to die after the COVID 
vaccine than after the flu vaccine. 


Theme 4: Downplaying Severity of COVID-19: Claims that COVID-19 is a hoax, not any worse than the flu, 
€te; 


They responded positively but asked as follow up: “Cas vou give us a sense of volume on these, and some 
metrics around the scale of removal for each?” 


They have a strong perception that we are not doing enough, and we want to respond to their clear requests when 
we can. 


We do have a general percentage breakdown of these themes against overall COVID violations but it has not 
cleared STAT review: 


Theme |: Vaccine Toxicity: 15% of all COVID Violations. 
Theme 2: False Claims About Side Effects of Vaccine: 3-5% of all COVID violations. 
Theme 3: Comparing the Covid Vaccine to the Flu Vaccine: 1°% of all COVID violations 


Theme 4: Downplaying Severity of COVID-19: Totals to ~45°% of all COVID violations. 


These percentages were not able to go through Stat review and we understand they were not approved to share. 
but we are flagging that we believe sharing some breakdown for prevalence of these four themes will help to 
build credibility with thts hostile audience, by responding directly to a question about the four themes. We would 
of course offer a caveat that these are rough estimates and only based on trends we are seeing from the last few 
weeks. 


While the percentages don’t answer the exact question posed by the White House team, they at least demonstrate 
some commitment on our end to meet their request. Moving forward, we do think it 1s important to start to share 
more information with them that will be helpful and we will work with the Data Transparency team to determine 
what can be shared on an ongoing basis that is more specific to their needs. 


For decision: 


Option A: Share these as rough percentages verbally and explain these are new stats that are not public and not 
to be shared. For example. /he claims around COVTD-19 are quite dvnamic given that the information we have 
is evolving rapidly, however, our preliminary look at recent data shows that approximately 435 percent of the 
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content ou our platforms falls into the general category of dawnplaving the severity of the COVTD-19 disease, 
fnehuding claims that no one has died from corouavirus or that the death tolf is much lower than officiat 
Figures. Approximately 13 percent of the recent claims deal with vaccine toxicity, tneluding claims that the 
racemes contain harmful ingredients or microchips, leatse claims ahout COUTD-19 vaccine side-effects und 
claims comparing the COUID-19 vaccine to the flu vaccine account for approximately 3 percent and 1 percent 
of claims on our platforms respectively. 


Option B: Discuss these themes in more relative terms. For example, we could say “/heme 4 aecounts for close 
to half of the violations, followed by Theme 1, We see Theme 2 and 3 with less frequency.” Or “The vast 
mijority of these claims are Theme 4, followed by Themes t, 2, ane 3 in that order.” Or perhaps re rank them in 
order of prevalence 


Option C: Say that we do not share this type of data. 


won't get through all of the content included here. but we plan for this to be an ongoing discusston around our 
work to curb Covid misinformation on the platform. 


Happy to organize a quick call Monday morning to discuss as well—as mentioned above the briefing is scheduled 
for 3:00 ET, and our team has scheduled a final walk through for 1:00 ET. 


Thanks, 
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Facebook and the White House 
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From: ME <0= THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8 111461E3692A624> 


To: Flaherty, Rob EOP/WHO 

Cc: Slavitt, Andrew M. EOP;/WHO 
Sent: 3/15/2021 7:22:12 AM 
Subject: Re: You are hiding the ball 


Thanks Rob—! think there is a misunderstanding on what this story is covering with respect to research that’s 
happening—| will call to clear up. Certainly not hiding the ball. 


Also flagging our announcement that went live this morming—this is the announcement | mentioned on Friday's call. 


https ://about.fb.com/news/2021/03/mark-zuckerberc-announces-facebo oks-plans-to-help-get-people-vaccinated- 
against-covid-19/ 


From: Flaherty, Rob EOP/WHO <| Qwho. cop. gov> 
Date: Sunday, March 14, 2021 at 11:13PM 

To: fb.com> 

Ce: Slavitt, Andrew M. EOPAVHO SE aio. cop.gov> 
Subject: You are hiding the ball 


Attos:/Awww.washinatonoost.com/technology/2021/03/14/facebook-vaccine-hesistancy-ganon 


Sent from my iPhone 
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From: GS </O= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251 C0920BB487E8111461E3692A624> 


To: Slavitt, Andrew M. EOP/WHO 

cc: Flaherty, Rob EOP/WHO 

Sent: 3/16/2021 4:17:59 PM 

Subject: Re: [EXTERNAL] Re: You are hiding the ball 


Thanks Andy, and apologies for the delay in getting back. We are absolutely invested in getting you the specific 
information needed to successfully manage the vaccine rollout. We want to share information with you that we 
trust is statistically significant and derived from sound analysis, so that it can actually be helpful. The information 
cited in the WaPo article over the weekend was leaked and was not vetted internally to understand how accurate it 
is or the ramifications that could result from it. But | understand your point regarding how we communicate, and 
that we need to share information with you in a way that prioritizes what we are seeing in as close to real time as 
possible. |’d like to set up a conversation with our research leads to walk your team through ongoing research we 
are currently conducting and our approach; and then we can prioritize sharing results as quickly as possible. 


Moreover, the data we sent on Friday and will continue to send throughout the year represents the information we 
are using internally to shape our own thinking on this content—we believe this data addresses many of the 
questions that have been posed (because it has been so helpful to guide our own internal efforts). We'd appreciate 
the opportunity to go through it in detail with whomever is interested on your team. 


| know you're extremely busy. If it's ever helpful to connect by phone instead of over email | am at 


From: Slavitt, Andrew M. EOP/WHO < 
Date: Monday, March 15, 2021 at 7:11 PM 
To: Of com> 

Ce: Flaherty, Rob EOP/WHO 
Subject: Re: [EXTERNAL] Re: You are hiding the ball 


| appreciate being copied on the note. It would nice to establish trust. | do feel like relative to others, interactions 
with Facebook are not straightforward and the problems are worse— like you are trying to meet a minimum hurdle 
instead of trying to solve the problem and we have to ask you precise questions and even then we get highly 
scrubbed party line answers. Ve have urgency and don't sense it from you all. 100% of the questions | asked have 
never been answered and weeks have gone by. 


who.eop.gov> 


Internally we have been considering our options on what to do about it. 
Regards, 
Andy 


Sent from my iPhone 


On Mar 15, 2021, at 6:42 PM, I @ fb.com> wrote: 


Thanks, Rob, Called and left youa message earlier. | understand why youd read the WaPo piece and come 
away feeling like we are not leveling with you. The piece inflated unconfirmed and leaked work that's being done by 
a small team. It’s exploratory work and is not close to being a finalized work product - in fact the team that briefed 
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you (including me) wasn’t aware of the work at the time we briefed you. This was not a “massive study” as 
depicted by the Post - this was a small team experimenting with applying a relatively new system to COVID19 
content. At any given time, there are many research projects similar to this being conducted by data scientists 
across the platform--as we've discussed, we're working hard to understand and address this type of content. Our 
definition of vaccine hesitancy is evolving - it is not a mature concept. This is early work and we have not gone 
through the kind of quality assurance we'd usually do before sharing the learnings externally. The data that leaked 
and was reported on should not be interpreted to be anything more than one of many efforts underway to better 
inform how we tackle this problem. As we develop them further, we will definitely Keep you updated. 


We obviously have work to do to gain your trust. You mention that you are not trying to play “gotcha” with us—| 
appreciate the approach you are taking to continued discussions. We are also working to get you useful 
information that’s on the level. That’s my job and | take it seriously—l’ll continue to do it to the best of my ability, 
and I'll expect you to hold me accountable. 


If interested, | can schedule time to give you more context on how this work is done and why we wouldn't include it 
in a briefing. 


From: Flaherty, Rob EOP/WHO <i @who. cop. gov> 
Date: Monday, March 15, 2021 at 1:10 PM 


To: Brian Rice <brianrice@fb.com> 


Ce: Slavitt, Andrew M. EOP/WHO <I Qwho.eop.gov> 
Subject: RE: You are hiding the ball 


| don't think this is a misunderstanding, Brian. I've been asking you guys pretty directly, over a series of 
conversations, for a clear accounting of the biggest issues you are seeing on your platform when it comes to 
vaccine hesitancy, and the degree to which borderline content — as you define it — is playing a role. I’ve also been 
asking for what actions you have been taking to mitigate it as part of your “lockdown” — which in our first 
conversation, was Said to be inresponse to concerns over borderline content, in our 1:1 convo you said was not 
out of any kind of concern over borderline content, and in our third conversation never even came up. 


You said you would commit to us that you'd level with us. | am seeing in the press that you have data on the impact 
of borderline content, and its overlap with various communities. | have asked for this point blank, and got, instead, 
an overview of how the algorithm works, with a pivot to a conversation about profile frames, and a 45-minute 
meeting that seemed to provide you with more insights than it provided us. 


| am not trying to play “gotcha” with you. We are gravely concerned that your service is one of the top drivers of 
vaccine hesitancy — period. | will also be the first to acknowledge that borderline content offers no easy solutions. 
But we want to know that you're trying, we want to know how we can help, and we want to know that you're not 
playing a shell game with us when we ask you what is going on. 


This would all be a lot easier if you would just be straight with us. 


From: fb.com> 

Sent: Monday, March 15, 2021 10:22 AM 
To: Flaherty, Rob EOP/WHO 
Ce: Slavitt, Andrew M. EOP/WHO 
Subject: [EXTERNAL] Re: You are hiding the ball 


who.eop.gov> 
who.eop.gov> 


Thanks Rob— think there is a misunderstanding on what this story is covering with respect to research that’s 
happening— will call to clear up. Certainly not hiding the ball. 
Also flagging our announcement that went live this morming—this is the announcement | mentioned on Friday's call. 


>>httos://about.fb.com/news/202 1/03/mark-zuckerberg-announces-facebooks-plans-to-help-get-people- 
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vaccinated-against-covid-19/<<; 


From: Flaherty, Rob EOP/WHO <{ @who. cop. gov> 
Date: Sunday, March 14, 2021 at 11:13PM 


To: iT O1> com> 


Cc: Slavitt, Andrew M. EOP/WHO <i Qwho.eop.gov> 


Subject: You are hiding the ball 
>>httos:/Awww.washingtonpost.com/technology/2021/03/14/facebook-vaccine-hesistancy-daanon<<; 


Sent from my iPhone 
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From: Nick Clegg </O=THEFACEBOCOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT}/CN=RECIPIENTS/CN=NCLEGGE6E> 


To: Slavitt, Andrew M. EOP; WHO 
cc: ieee te 

Sent: 4/13/2021 9:18:06 AM 

Subject: Re: [EXTERNAL] Re: Connecting 
Hi Andy 


+ 


Hope this finds you well? 
Re the J+J news, we're keen to amplify any messaging you want us to project about what this 
Means for people - it obviously has the risk of exacerbating vaccine hesitancy, so we're 
keen to get ahead of the knock-on effect. Don’t hesitate to tell me - or via your teams - 
how we can help to provide clarity/reassurance via Facebook. 


All v best 


On 3/2¢/21, 4:17 AM, "Slavitt, Andrew M. EOGP/WHS" ti‘ sé‘ CR Ton wrote: 
Nick, 


I heard the same. Which is really nice given that things are starting to heat up on the 
topic. So thank you. Look forward to the follow up. 


Sent from my iPhone 

On Mar 26, 2621, at 1:40 AM, Nick Cleqg <E fb . com> wrote: 

Andy - I'm told the first meeting between Fe oe who I suqgested could serve as 
he best Facebook operational point of contact for your team, and Rob Flaherty on Friday 


went well. Do tell me if you hear otherwise - or if there are areas we should push on which 
haven't been covered? 


> 
> 
> 
Be 


> 

> All best 

> 

» Nick 

> 

> Gn 3/15/21, 4:28 PM, “"Slavitt, Andrew M. EOP/#HG" cS 00ti‘é é‘éaR wrote: 
> 

> Thanks for the call. My mobile i iim Look forward to follow up. Really 


appreciate it. 

> 

> All the best, Andy 

> 

> Sent from my iPhone 

>> On Mar 1%, 2021, at 3:24 BM, Nick Clegg RP b>. com> wrote: 


>> Hi Andy 


>> My cell as promised: Sa 


>> 
>> Plse don’t hesitate to get in touch as/when needed - it was great to make initial 
contact, and I cannot stress enough the urgency and importance which we attach to this from 
the top of the company downwards. 

>> 

>> Best 

>> 

>> Nick 

>> 


>> on 3/LlEé/2l, €:41 PM, “Slavitt, Andrew M. ECP/WHO" <2. eop. gov> wrote: 
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>> 
>> Nick 

>> 

>> Andy Slavitt. I’m working on the White House CCVID team with Jeff Zients. If you have a 
few minutes this week I would love to connect. Thanks very much. 

>> 

>> Andy 

>> 

>> Sent from my iPhone 

>> 

> 
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Brief: Call with White House Senior Advisor on Covid-19 


You are meeting with Andy Slavitt, White House Senior Advisor on the COVID-19 Response (AKA White 
House Covid Task Force) at his request. We should use this meeting to re-establish trust and demonstrate 
our commitment to being a strong partner in ending the pandemic. Andy thinks Facebook lacks urgency 
to meet the problem of Covid misinformation. Facebook staff has provided two briefings to White House 
staff on Facebook’s approach to Covid misinformation, most recently on borderline vaccine hesitancy 
content last Friday. We also shared a long report with CMU on our Covid Symptom Survey data on 
vaccine intent and referred to it in the meeting. But two days later, the Washington Post published leaked 
research from a single data scientist regarding QAnon and vaccine hesitancy content on the platform. 
This led the White House to feel we were withholding relevant information, which undercut our message 
that we were being transparent about our approach and sharing relevant data. 


LOGISTICS 
@ Date/ Time: Friday, March 19, 2021 | 11:30 - 12:00 PM PT 
© Zoom: Link here | Meeting ID: 161 703 1973| Password: 246419 
e Appropriate greeting: Andy 
e FB Attendees: Nick Clegg, 
e External Attendees: Andy Slavitt (Andy could be joined by Rob Flaherty, WH Digital Director, who 


has been most engaged at the White House on FB and misinformation) 
e Flags: Andy has communicated by email to GB accing his concern, lack of trust, and 
what he perceives to be non-responsiveness to questions around COVID-19 misinfo. 
© “| appreciate being copied on the note. It would be nice to establish trust. | do feel like 
relative to others, interactions with Facebook are not straightforward and the problems 
are worse— like you are trying to meet a minimum hurdle instead of trying to solve the 
problem and we have to ask you precise questions and even then we get highly 
scrubbed party line answers. We have urgency and don’t sense it from you all. 100% of 
the questions | asked have never been answered and weeks have gone by.” 
@ Tone: Concerned, understanding Andy’s and the White House’s point of view. Looking for ways 
to collaborate. 
e@ Last Exec Touchpoint: Andy joined a WH call with several FB policy reps on 3/1 to talk about 
misinformation. 


MEETING GOALS 


1. Build trust and demonstrate that we are committed to being a strong partner 

2. Make clear that we are not trying to hide anything, and we are sharing what we think is most 
helpful and will work to share more based on what the White House views as helpful info. Offer 
up further briefings on the survey data we shared Friday, ongoing integrity efforts [TBC - subject 
to discussions with Molly et al tomorrow morning], ongoing research efforts that are not 
complete [TBC], and policy updates that we are in the process of making. 

3. Reinforce messages we have shared before about our work on misinfo and harmful content. 
Reiterate that experts have told us that removal is not always the answer for a number of 
reasons - namely that being able to engage in debate and learn drives behavior change. That is 
why amplifying authoritative information is a key part of our strategy (consistent with WaPo op 


ed) 
KEY MESSAGES 
1 
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e We havea sense of urgency to get more people vaccinated: This is a key goal of our company as 
a whole and we know it is yours too - we want to partner with you and work together. 
@ Weare not hiding info from you and are sharing what we find to be most helpful to our 
approach: 
© We understand how the recent WaPo article could make it seem like there is critical 
information we have that we are not sharing. This is not true. 
Oo We have lots of ongoing research at any given time especially to better understand the 
space of vaccine hesitancy. 
© What was leaked in the Washington Post was just an experiment run by one data 
scientist and is not something we would normally share because it has not been 
validated. 
© We want to share information - like the CMU Covid Symptom Survey data we shared 
with you on Friday - that we have found internally as helpful to our efforts, and that we 
trust is statistically significant and derived from sound analysis, so that it can actually be 
helpful for you. 
© We would like the opportunity to further brief you on this data [TBC] and on ongoing 
research efforts that may not be complete so you have a better understanding of the 
kinds of things we are looking into]. 
fo) HE ould be happy to brief you on our integrity efforts [TBC]. 
e Combating misinformation is a top priority for our company: 
© Weknow you are concerned about misinformation and content that could lead to 
vaccine hesitancy. 
We are too and this is a top priority for our company across our family of apps. 
© We have made unprecedented updates to our policies and enforcement tooling and are 
removing more content that we think could lead to harm; we are also reducing the 
spread of content that isn’t violating but we think could lead to hesitancy. 
© Weare working on producing a ‘top 1000’ report which will show how many of the most 
widely viewed stories on FB contain vaccine hesitancy content. This will provide a picture 
of the most obvious / visible content. Getting the number as close to zero as possible 
means that people have to look much harder to find the content. We will be able to 
share this data with you. The teams are working on this, but it will take a number of 
weeks to get there - we can update you when we have a better idea of timescale. 


CONTEXT 

@ We have had ongoing conversations for the last year with the Biden campaign, transition, and 
now Administration around our approach to misinformation. While the campaign was focused 
mainly on enforcement of our misinfo policies, the White House is now focused on “the scope of 
the problem” of vaccine hesitancy content. They have told us in meetings that they are simply 
trying to understand what we are seeing as the scope of the problem so they can respond 
effectively. 

e@ We purposely have focused the conversation mainly on offensive efforts such as product 
features we are launching to help increase mask wearing and vaccinations. They have reiterated 
that while they view proactive work as positive, they are mainly concerned with how we are 
treating misinfo defensively. 

e We have now conducted two briefings on Covid on 3/1 and 3/12. Andy joined the first meeting, 
and the team shared that we are in a lockdown on Covid misinfo. This piqued Andy’s interest and 
he asked follow up questions (“how close are you to being done? 10%? 50%?”) to which we did 
not have a good answer. (‘Lockdown’ is the term that internal teams use to describe a defined 
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time that they use to focus on a problem - in this case understanding what additional steps they 
would take on misinfo. eae and (offered later that it should not have been 
mentioned, and asked to walk back the statement about the lockdown and not mention it 
again). We followed up with an explanation that walked back the idea that we are in lockdown 
for a period of time before we actually implement solutions. 

e Our second briefing was focused on borderline content on 3/12--this session was more 
productive but Andy did not attend. Prior to this meeting we sent the CMU Covid Symptom 
Survey (executive summary sent to you as a PDF) - which we believe answers many of the 
questions that they have. We were hoping for the next follow up to be a deep dive on this 
report. 

e@ The progress made on 3/12 was unfortunately derailed once the Washington Post article came 
out over the weekend with leaked research linking vaccine hesitancy content with QAnon, which 
we did not cite in our meeting on Friday. They feel that we are hiding critical information from 
them, though this was just an experiment run by one data scientist and is not something we 
would share because it has not been fully validated. 

e@ This resulted in some back and forth email correspondence with where Andy and Rob 
Flaherty (White House Digital Director) explained that they felt Facebook is “hiding the ball,” 
does not have a sense of urgency around these issues, and isn’t answering their questions. They 
also offered it is being discussed within the broader White House. Last correspondence was an 
email fror@iiiifon 3/16 in the evening; and then Andy reached out to Nick directly for a 
meeting. Full email correspondence is below. 


TALKING POINTS 


Misinfo 
Context: 

e@ Andy has expressed concerns that FB is the #1 source of information for people who have 
decided not to get the vaccine. He said that despite what sound like good, valuable, valid policy 
efforts, we are not getting at the big picture and beyond policies vs measuring effect. i=] 
| GE es ponded to this concern on the 03/01 briefing 

Lines: 
@ We have made some recent changes to our policies that we think help us to be in the right place, 
and are continuing to make more. 

© In December, we began removing false claims about Covid-19 vaccines that could lead to 
imminent harm, including false claims about the safety, efficacy, ingredients or side 
effects. In February, we made some significant updates to our policies including 
removing widely debunked hoaxes and repeatedly fact checked hoaxes, content that we 
previously reduced visibility of but did not remove. 

© This has resulted in us removing significantly more content than we would for any other 
policy space. 

© For example, in Q4 last year, we removed over 1 million pieces of content on Facebook 
and Instagram globally for containing misinformation on COVID-19. 

© Since launching our new expanded policy on Feb 8th, we removed an additional 900K 
pieces of content in the US and more than 2M globally in just a few weeks since launch 
which shows the impact of these new expansions. 

Oo Wearen’t perfect and continue to try to better understand where the most problematic 
areas are and adjust our policies accordingly. We are working on other policy expansions 
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that are not finalized yet but we would be happy to preview them with you as well. We 
want to partner with you here and understand exactly what will be most helpful for you. 
® Experts have told us that removal is not always the answer for a number of reasons - namely 
that being able to engage in debate and learn drives behavior change. That is why amplifying 
authoritative information is also a key part of our strategy (WashPo opinion piece that mentions 
this attached as PDF to your package). 
® When we see misinfo, we try to get out better information in the COVID-19 hub that we have 
had going since May 2020. We have surfaced over 2B hits to that hub, and a third of people 
actually click through. 


Research 
Context: 

e After the WaPo article came out, there is a sense that we are “hiding the ball” on research that 
we are not sharing with them that they could find helpful. On Friday 3/12, after the meeting on 
borderline content, we shared the CMU Covid Symptom Survey results that we think will be very 
helpful with them. To date, we are sharing things that are internally validated so we know it is 
reliable and could help them, but are open to sharing work in progress too given the trust deficit. 
We have already offered meetings with data research leads to discuss ongoing work. 


Lines: 

@ This space is ever evolving and we have many people working on experiments and research at 
any given time to better understand it. The information that was leaked was an exploratory 
analysis based on tools with limited precision and has not been fully caveated or validated. Many 
of the classifiers that we used for this study are still being built. [We would be happy to 

® The information shared in the WaPo article was leaked and did not go through the kind of quality 
assurance we'd usually do before sharing. It’s basically the equivalent of a junior staffer sharing a 
preliminary analysis internally -- it's not just not ready for external use, and it doesn't even meet 
our internal quality bar. 

® The QAnon statements are based on an analysis last year that detected higher presence of 
QAnon content in these segments. 

@ This year's analysis did not check whether these segments still have high prevalence of QAnon. 
We have separate efforts pursuing QAnon reduction. 

@ We have focused our sharing with you on what we have validated —such as the CMU Covid 
Symptom Survey data we provided on Friday. This is the research we are using to guide our own 
efforts to increase vaccinations. We think it will be helpful for you too and would love to have 
our research director brief you on this and do a deep dive. 

e® [TBC: We can have our research director walk you through research that is ongoing - and not 
validated, and then when it is complete we can come back and share the results. We would love 
your feedback as well on areas to deep dive on]. 


KEY STATS 


Covid-19 Misinfo Topline 
® Removed over 12 million pieces of Covid-19 related misinformation that could lead to imminent 
physical harm - like false claims about cures or treatments. 
@ inQ4, we removed over 1 million pieces of content on Facebook and Instagram globally for 


containing misinformation on COVID-19 that may lead to imminent physical harm, such as 
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content relating to fake preventative measures or exaggerated cures. Since launching our new 
expanded policy on Feb 8th, we removed an additional 900K pieces of content in the US and 
more than 2M globally in just a few weeks since launch which shows the impact of these new 
expansions. 


FB as vaccine hesitancy source Topline 


We have connected over 2 billion people to authoritative information and resources through our 
Covid-19 Information Center 

And we're partnering with local and national health authorities like the CDC, local health 
agencies, the WHO and UNICEF to help them get out timely, accurate information on the 
coronavirus, often using free ads. 

We are running the largest worldwide campaign to promote authoritative information about 
vaccines: helping people find where and when they can get vaccinated, giving $120 million to 
promote vaccine and health info, and providing data to inform effective vaccine delivery and 
educational efforts to build trust in Covid-19 vaccines. 

We're also working to amplify content that directly serves communities where vaccine intent 
and access may be lower. 


Deliverables that we have committed to 


Crowdtangle full access: We got an exception to grant the White House full access to 
Crowdtangle as of late last week for Covid research. We have offered them logins and training, 
but they have yet to initiate the onboarding. They were very happy to get this and are very 
familiar with this tool from prior work. 
© This will help the White House be able to better understand the trends and what content 

is gaining traction on our platform. The Crowdtangle team will also create a report every 

few weeks with a summary of trends. (This is the current support we provide CDC.) 
Enforcement numbers for misinformation: in the 3/1 meeting, we shared our most recent 
enforcement numbers and committed to sharing this out monthly; next share will be 4/1. 
CMU Covid Symptom Survey: We shared this data with them on Friday after the 3/12 meeting 
with executive summaries targeted towards their interests. There is a lot of helpful information 
in here that we think answers many of their questions and we want to do a briefing of this with 
them. We have committed to sharing regular updates of this survey data just as we do with the 
CDC team, who we worked with on survey questions. 


WATCHOUTS 


Data 


Andy is very interested in getting more data on “the scope of the problem” from us and we do 
not have this data to share externally. We interpret this as prevalence, which we do not currently 
track but are in the process of building (with low accuracy to date). 
[IF ASKED: why we can’t provide data] 
© We want to share what will actually be helpful and not things that are speculation. The 
survey data we shared is what we have found to be the most helpful in guiding our 
efforts. 
© We have also committed to sharing out our misinformation enforcement metrics on a 
regular basis and we will continue to do this. 
© [If he asks for specific data, say you will check back with the team on this] 
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Lockdown 

e Inaprior meeting, to show our commitment to these issues, we mentioned that we are in a XFN 
lockdown to sprint on efforts focused on misinfo and vaccine hesitancy. This was of particular 
interest to Andy and he wanted to know % completed, what deliverables were, etc. Teams on 
the call were not cleared to share that information and we haven’t followed up on specifics 
since; Andy became frustrated and took this inability to answer as stonewalling / hiding. 

e [If asked about lockdown] 

© This is just an internal term used for a focused sprint and just reflects that this work is a 
priority for us (as it has always been). Do not commit to sharing results of the sprint. 


Authoritative info 
e@ They don’t care that much about our approach to amplifying authoritative info. When = 
mentioned the Covid Information Center, Rob audibly laughed. They feel the growing 
overabundance of misinfo outweighs and outpaces passive hub type offerings/product offerings. 


ANDY SLAVITT | WHITE HOUSE SENIOR ADVISOR ON THE COVID-19 RESPONSE 


Known as one of the most influential and prominent health care leaders in the 
U.S., Andy Slavitt served as Acting Administrator of the Centers for Medicare and 
Medicaid Services (CMS) from 2015-2017, and is currently Board Chair of the 
non-profit organization United States of Care. He currently serves as the White 
House Senior Advisor on the COVID-19 response. The full scope of his duties is 
unknown at this time, but he is a trusted add to the Biden team’s response. 


He is a graduate of the Wharton School and The College of Arts & Sciences at the University of 
Pennsylvania, and received an MBA from Harvard Business School. He is married to Lana Etheringto; they 
have two sons, Caleb and Zachary. 


APPENDIX 


Relevant Email Correspondence: 
From: Flaherty, Rob EOP/WHO <Robert.Flaherty@who.eop.gov> 
Date: Monday, March 15, 2021 at 1:10 PM 


Cc: Slavitt, Andrew M. EOP/WHO <Andrew.M.Slavitt@who.eop.gov> 
Subject: RE: You are hiding the ball 


“| don’t think this is a misunderstanding, MMl’ve been asking you guys pretty directly, over a series of 
conversations, for a clear accounting of the biggest issues you are seeing on your platform when it comes 
to vaccine hesitancy, and the degree to which borderline content — as you define it — is playing a role. I’ve 
also been asking for what actions you have been taking to mitigate it as part of your “lockdown” — which 
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in our first conversation, was said to be in response to concerns over borderline content, in our 1:1 convo 
you said was not out of any kind of concern over borderline content, and in our third conversation never 
even came up. 


You said you would commit to us that you’d level with us. | am seeing in the press that you have data on 
the impact of borderline content, and its overlap with various communities. | have asked for this point 
blank, and got, instead, an overview of how the algorithm works, with a pivot to a conversation about 
profile frames, and a 45-minute meeting that seemed to provide you with more insights than it provided 
us. 


| am not trying to play “gotcha” with you. We are gravely concerned that your service is one of the top 
drivers of vaccine hesitancy — period. | will also be the first to acknowledge that borderline content offers 
no easy solutions. But we want to know that you’re trying, we want to know how we can help, and we 
want to know that you’re not playing a shell game with us when we ask you what is going on. 


This would all be a lot easier if you would just be straight with us.” 


KEE 


From: Slavitt, Andrew M. EOP/WHO <Andrew.M.Slavitt@ who.eop.gov> 
Sent: Monday, March 15, 2021 7:11 PM 

To: 

Cc: Flaherty, Rob EOP/WHO 

Subject: Re: [EXTERNAL] Re: You are hiding the ball 


| appreciate being copied on the note. It would nice to establish trust. | do feel like relative to others, 
interactions with Facebook are not straightforward and the problems are worse— like you are trying to 
meet a minimum hurdle instead of trying to solve the problem and we have to ask you precise questions 
and even then we get highly scrubbed party line answers. We have urgency and don’t sense it from you 
all. 100% of the questions | asked have never been answered and weeks have gone by. 


Internally we have been considering our options on what to do about it. 


Regards, 
Andy 
Z 
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From: GR «0 THEFACEBOOK/OU-EXTERNAL (FYDIBOHF25SPDLT)/CN-RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Slavitt, Andrew M. EOP/VWHO 
Cc: ho.eop.gov 
Sent: 3/21/2021 8:24:43 PM 
Subject: Follow up - Friday call w Nick 
Andy, 


Thanks for taking the time to connect on Friday. Per our discussion, | wanted to follow up with next steps: 


1. Consistent Product Team POC: As discussed, we will make f wno has been ccordinating 
the product work that matters most to your teams, available on a regular basis. If it makes sense, we can 
schedule some time foro connect with you and/or Rob (and whomever else makes sense) early 
this week. 

2. Sharing Additional Data: Nick mentioned the new internal analytics that we are developing to help us 
understand and monitor the most viral COVID vaccine-related content. This is a top priority for us, and we 
will Keep you updated on our progress and when we expect to be able to share the data with you. 

3. Levers for Tackling Vaccine Hesitancy Content: You also asked us about our levers for reducing virality 
of vaccine hesitancy content. In addition to policies previously discussed, these include the additional 
changes that were approved late last week and that we'll be implementing over the coming weeks. As you 
know, in addition to removing vaccine misinformation, we have been focused on reducing the virality of 
content discouraging vaccines that does not contain actionable misinformation. This is often-true content, 
which we allow at the post level because experts have advised us that it is important for people to be able to 
discuss both their personal experiences and concerns about the vaccine, but it can be framed as sensation, 
alarmist, or shocking. We'll remove these Groups, Pages. and Accounts when they are disproportionately 
promoting this sensationalized content. More on this front as we proceed to implement 

4, WhatsApp: Finally--Nick mentioned the policies that apply to WhatsApp. WhatsApp's approach to 
misinformation focuses on limiting the virality of messages, preventing coordinated abuse, and empowering 
users to seek out reliable sources of information both in and out of the product. Our product includes 
features to limii the spread of viral content, such as forward limits and labels, privacy settings to help users 
decide who can add them to groups, and simple ways for users to block accounts and make reports to 
WhatsApp if they encounter problematic messages. Additional limitations we placed in April 2020 on 
forwarding of messages that have been forwarded many times reduced these kinds of messages by over 
70%. 


Along with these commitments, we'll continue to provide updated data from our COVID-19 Symptom Survey, and 
would be happy to walk through this data with our research director, if helpful. 


Thanks again-and please let me know if there’s anything I’m missing or can follow up to clarify. 
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From: GE «0 = THEFACEBOOK/OU-EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO 

cc: Slavitt, Andrew M. EOP/WHO 

Sent: 3/24/2021 6:42:30 AM 

Subject: Re: [EXTERNAL] Re: Follow up - Friday call w Nick 


Look forward to talking today at 4:00. | plan on giving an overview of her role and the work across the 
teams at the top and of course will respond to questions, as that's the objective of having her in touch with you 
regularly over the coming weeks, One additional participant on our end will be —— to make sure 
we're tracking all follow ups. 


From: Flaherty, Roo EOP/WHO ow: eop.gov> 
Date: Tuesday, March 23, 2021 at 11:16 AM 
To fb.com> 


Ce: Slavitt, Andrew M. EOP/WHO <I who. eop.gov> 


Subject: RE: [EXTERNAL] Re: Follow up - Friday call w Nick 


Great. | can do 4! 


From: fb.com> 
Sent: Tuesday, March 23, 2021.11:03 AM 


To: Flaherty, Rob EOP/WHO < who eop.gov> 
Cc; Slavitt, Andrew V. EOP/WH @who.eop.gov> 
Subject: Re: [EXTERNAL] Re: Follow up - Friday call w Nick 


Rob--we're good to schedule around your avail Wednesday afternoon if that works. 


From: Flaherty, Rob EOP/WHO <{who. cop. gov> 


Date: Monday, March 22, 2021 at 11:21 PM 
To: fb.com> 


Ce: Slavitt, Andrew M. EOP/WHO <Q who.eop.gov> 
Subject: Re: [EXTERNAL] Re: Follow up - Friday call w Nick 


| believe you mentioned in a previous conversation that large meetings like that are not the most 
productive way to exchange information on this topic. | certainly have not found them to be especially illuminating. 
lf we're going to do another large format meeting, can you outline what you'll be bringing to the table? Otherwise, it 
seems like a smaller group may be more productive. 


Sent from my iPhone 


On Mar 22, 2021, at 10:58 PM, J fb.com> wrote: 


Thanks Rob—appreciate the context below. For the meeting with [possible that we could aim for 
Wednesday? I'll rally our folks if you have a window in the afternoon that will work. 


From: Flaherty, Roo EOP/WHO S ti‘éN TON 
Date: Monday, March 22, 2021 at 4:51 PM 
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To: ofp com>, Slavitt, Andrew m. EoP/WHO <[owho. cop. gov> 
Subject: RE: Follow up - Friday call w Nick 


Awesome [EM Similarly to how we're looking out for your gameplan on tackling vaccine hesitancy spread on 
your platform, we'll look out for how you plan to help close the gap on equitable access. 


Had a chance to connect with Andy earlier to download on his call with Nick — seems like there’s alignment here. 
Excited to meet [I Coud talk tomorrow in the 4-5 hour ET tomorrow. 


Afa sharing data, that's great. Again, as |'ve said, what we are looking for is the universe and scale of the problem. 
You noted that there is a level below sensational stories that get down-ranked, which took the form of general 
skepticism. | think it is helpful to know where you think the biggest issue is. | think we are all aligned that the 
problem does not sit in “microchips”-land, and that it seems plausible that the things that drive the most actual 
hesitancy sit in “sensational” and “skeptical.” If you're downranking sensational stuff — great — but | want to know 
how effective you've seen that be from a market research perspective. And then, what interventions are being 
taken on “skepticism?” | could see a range of actions, including hitting them good information, boosting information 
from sources they've indicated they trust, promoting content from their friends who have been 
vaccinated........what are you trying here, and again, how effective have you seen it be. And entically, what amount 
of content is falling into all of these buckets? Is there wider scale of skepticism than sensationalism? | assume 
given the Carnegie data and the studies |’ve seen in the press that you have this. While | think you and! both know 
that access to the study’s toplines and a crowdtangle account aren't going to get us the info we're looking for, it 
shows to me that you at least understand the ask. 


As I've said: this is not to play gotcha. Itis to get a sense of what you are doing to manage this. This is a really 
tricky problem. You and | might disagree on the plan, but! want to get a sense of the problem and a sense of what 
you solutions are. 


On whatsapp, which | may seem like I'm playing gotcha, but | guess I’m confused about how you're measuring 
reduction of harm. If you can’t see the message, I’m genuinely curious —how do you know what kinds of messages 
you've cut down on? Assuming you've got a good mousetrap here, that’s the kind of info we're looking for above: 
what interventions you've taken, and what you've found to work and not work? And how effective are you seeing 
the good information on Whatapp be? Are you doing crossplatform campaign work to try to reduce people’s 
exposure on whatsapp? As we worry about equity and access, Whatsapp is obviously a central part of that given 
its reach inimmigrant communities and communities of color. 


You've given us a commitment to honest, transparent conversations about this. We're looking for that, and hoping 
we can be partners here, even if it hasn’t worked so far. | know Andy is willing to get on the phone with Nick a 
couple of times per week if its necessary to get all of this. 


Looking forward. 


From I t.com> 

Sent: Monday, March 22, 2021 12:53 PM 

To: Slavitt, Andrew M. EOP/WHO who.eop.gov> 
Ce: Flaherty, Rob EOP/WHO who eop.gov> 
Subject: [EXTERNA_] Re: Follow up - Friday call w Nick 


Thanks Andy, Also—wanted to flag a discussion we are scheduled to have with Dr. Cameron Webb regarding 
some work around equitable vaccine adoption—just a touch-base conversation to talk through ideas we have for 
closing the adoption gap in communities disproportionately impacted by Covid and to discuss how we can be 
supportive overall in the US re: an equity strategy. Wve were connected with Dr. Webb who scheduled the 
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conversation—just didn't want any surprises. 


From: Slavitt, Andrew M. EOP/VWWHO {A 2w)\0.c0p.g0v> 


Date: Monday, March 22, 2021 at 9:37 AM 
To: fb.com> 
Ce: Flaherty, Rob EOP/WHO 
Subject: RE: Follow up - Friday call w Nick 


@who.eop.gov> 


Thanks Bob and | will cOonnect and follow up. 


From: @fb.com> 

Sent: Sunday, March21, 2021 11:25 PM 

To: Slavitt, Andrew M. EOP/WHO < @who.eop.gov> 
Ce: Flaherty, Rob EOP/WHO < 0.e0p.gov> 
Subject: [EXTERNA_] Follow up - Friday call w Nick 


Andy, 


Thanks for taking the time to connect on Friday. Per our discussion, | wanted to follow up with next steps: 


1, Consistent Product Team POC: As discussed, we will make I who has been coordinating 
the product work that matters most to your teams, available on a regular basis. If it makes sense, we can 
schedule some time for fifo connect with you and/or Rob (and whomever else makes sense) early 
this week. 

2. Sharing Additional Data: Nick mentioned the new internal analytics that we are developing to help us 
understand and monitor the most viral COVID vaccine-related content. This is a top priority for us, and we 
will keep you updated on our progress and when we expect to be able to share the data with you. 

3. Levers for Tackling Vaccine Hesitancy Content; You also asked us about our levers for reducing virality 
of vaccine hesitancy content, In addition to policies previously discussed, these include the adcitional 
changes that were approved late last week and that we'll be implementing over the coming weeks. As you 
know, in addition to removing vaccine misinformation, we have been focused on reducing the virality of 
content discouraging vaccines that does not contain actionable misinformation. This is often-true content, 
which we allow at the post level because experts have advised us that it is important for people to be able to 
discuss both their personal experiences and concerns about the vaccine, but it can be framed as sensation, 
alarmist, or shocking. We'll remove these Groups, Pages, and Accounts when they are disproportionately 
promoting this sensationalized content. More on this front as we proceed to implement 

4. WhatsApp: Finally--Nick mentioned the policies that apply to WhatsApp. WhatsApp’s approach to 
misinformation focuses on limiting the virality of messages, preventing coordinated abuse, and empowering 
users to seek out reliable sources of information both in and out of the product. Our product includes 
features to limit the spread of viral content, such as forward limits and labels, privacy settings to help users 
decide who can add them to groups, and simple ways for users to block accounts and make reports to 
WhatsApp if they encounter problematic messages. Additional limitations we placed in April 2020 on 
forwarding of messages that have been forwarded many times reduced these kinds of messages by over 
70%. 


Along with these commitments, we'll continue to provide updated data from our COVID-19 Symptom Survey, and 
would be happy to walk through this data with our research director, if helpful. 


Thanks again—and please lat me know if there’s anything I’m missing or can follow up to clarify. 
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From: </O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 

To: who.eop.gov 

Sent: 3/28/2021 5:51:23 PM 

Subject: Follow up from Friday meeting--additional context re: WhatsApp 

Rob, 


Thanks again for meeting with us Friday. As discussed, we would love to set up some time with our research 
director Curtiss Cobb who could join in Our next meeting to brief you on our CMU Covid-19 Survey that 
we shared a few weeks ago. Let us know if you’ re interested in covering that this week. 


We also wanted to follow up on your questions about WhatsApp. I’m sure you're already attuned to this, but 
think it’s worth noting some of the key differences between a private messaging app like WhatsApp, and social 
media like Facebook and Instagram. Approximately 90 percent of the messages sent on WhatsApp are 
one-to-one, and the majority of group chats include fewer than ten people. WhatsApp does not promote content, 
and users do not build audiences or discover new people as they would on social media. 


You’ re right that without being able to see the content of messages on WhatsApp, we’re not able to measure 
prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to control the spread of 
misinformation and inform users through deliberate, content-agnostic product interventions -- things like labeling 
and limiting message forwards. The underlying idea there is that messages that did not originate from a close 
contact are less personal compared to typical messages sent on WhatsApp, and may be more prone to contain 
misinformation. The labels (“ forwarded”; and “forwarded many times” if the message has been forwarded five 
times or more) are intended to prompt people to stop and think when they are reading a message and before they 
forward something, which may not be accurate. The forward limits (no more than five chats at time; one chat a 
time for highly forwarded messages), are intended to reduce their spread. As mentioned in my earlier note, when 
WhatsApp rolled out the limitation for highly forwarded messages to one chat at a time in April 2020, this 
resulted in a 70% reduction of those messages globally. Of course, not all forwards are misinformation, so these 
are by nature somewhat blunt tools, but they are important ones -- and ones that many other messaging services 
don’t provide. 


A few additional things to note: 


1. WhatsApp also employs best-in-class spam detection technology to spot accounts engaging in mass 
messaging behavior, so they can’t be used to spread spam or viral misinformation. VVe ban over 2 million 
accounts per month for bulk messaging behavior, 75% of them without a recent user report, which means our 
automated systems stop abuse before users can report them. (This white paper describes these systems in 
further detail.) 


2. Another aspect of what WhatsApp does -- again without accessing the content of messages -- is to provide 
tools to empower users to seek out reliable sources of information. One way we've done this in the product 
is through a “search the web” feature we rolled out last August, which allows users to easily double check highly 
forwarded messages they receive on WhatsApp by tapping a magnifying glass button in the chat to initiate a 
web search on their device browser. This helps users find news results or other sources of authoritative 
information about messages they have received from outside their close contacts -- and is available in English, 
Spanish, and other languages. 


3. WhatsApp also has partnerships with fact checking organizations, government agencies, and international 
organizations, like the WHO, around the world to make authoritative information about COVID-19 and 
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From: GE <0=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251 CO920BB487E6111461E3692A624> 


To: Flaherty, Rob EOP/WHO 
Sent: 4/1/2021 6:18:21 AM 
Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


Just checking back here—we can also shoot for early next week if that’s easier at this point? 
g y Pp 


Get Outlook tor 1OS 


Form: I com> 
Sent: Wednesday, March 31, 2021 11:58 AM 

To: Flaherty, Rob EOP/WHO 

Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


More shortly on other WA questions—but wanted to provide times — can we shoot for a window late afternoon 
(4 or after} on either Thursday or Friday? 


Get Outlook for 1OS 


From: Flaherty, Rob EOP/WHO <f@who.ecop.gov> 


Sent: Tuesday, March 30, 2021 7:35:08 PM 
To: A #0. com> 


Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Responses in line! 


From: fb.com> 
Sent: Sunday, March 28, 2021 8:51 PM 
To: Flaherty, Rob EOP/WHO who.eop.gov> 

Subject: [EXTERNAL] Follow up from Friday meeting--additional context re: WhatsApp 


Rob, 


Thanks again for meeting with us Friday. As ciscussed, we would love to set up some time with our research 
director Curtiss Cobb who could join Lindsay tn our next meeting to brief you on our CMU Covid-19 Survey that 
we shared a few weeks ago. Let us know 1f you're interested in covering that this week. 


All for it, Thursday better than Friday for me, Send some times over and we can coordinate. 


We also wanted to follow up on your questions about WhatsApp. I’m sure you re already attuned to this, but 
think it’s worth noting some of the key differeaces between a private messaging app like WhatsApp, and social 
media like Facebook and Instagram. Approximately 90 percent of the messages sent on WhatsApp are 
one-to-one, and the majority of group chats include fewer than ten people. WhatsApp does not promote content, 
and users do not build audiences or discover new people as they would on social media. 


Very aware oo 
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You're right that without berng able to see the content of messages on WhatsApp, we're not able to measure 
prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to control the spread of 
misinformation and inform users through deliberate. content-agnostic product interventions -- things like labeling 
and limiting message forwards. The underlying idea there Is that messages that did not originate from a close 
contact are less personal compared to typical messages sent on WhatsApp, and may be more prone to contain 
misinformation. The labels (“forwarded™: and “forwarded many times” if the message has been forwarded five 
times or more) are intended to prompt people to stop and think when they are reading a message and before they 
forward something, which may not be accurate. The forward limits (no more than five chats at time; one chat a 
time for highly forwarded messages), are intended to reduce their spread. As mentioned in my earlier note, when 
WhatsApp rolled out the limitation for highly forwarded messages to one chat at a time in April 2020, this 
resulted in a 70% reduction of those messages globally. Of course, not all forwards are misinformation, so these 
are by nature somewhat blunt tools, but they are important ones -- and ones that many other messaging services 
don’t provide. 


A few additional things to note: 


1. WhatsApp also employs best-in-class spam detection technology to spot accounts engaging in mass 
messaging behavior, so they can’t be used to spread spam or viral misinformation. We ban over 2 
million accounts per month for bulk messaging behavior, 75% of them without a recent user report, which 
means our automated systems stop abuse before users can report them. (This white paper describes these 
systems in further detail.) 


We have a thing where we can’t click links from emails — can you send me the white paper? 


2. Another aspect of what WhatsApp does -- again without accessing the content of messages -- is to provide 
tools to empower users to seek out reliable sources of information. One way we've done this in the 
product is through a “search the web” feature we rolled out last August, which allows users to easily double 
check highly forwarded messages they receive on WhatsApp by tapping a magnifying glass button in the 
chat to initiate a web search on their device browser. This helps users find news results or other sources of 
authoritative information about messages they have received from outside their close contacts -- and is 
available in English, Spanish, and other languages. 


Can you show me what this might look like? What kind of testing have you seen around effectiveness? Are 
there other tactics you’ve deployed? Does exposure to forwarded messages change in any way the kinds 
of positive information they’re exposed to on Facebook or Instagram? 


3. WhatsApp also has partnerships with fact checking organizations, government agencies, and international 
organizations, like the WHO, around the world to make authoritative information about COVID-19 and 
vaccines available via WhatsApp. WhatsApp donated $1M to the International Fact Checking Network 
(IFCN) to support the CoronaVirusFacts Alliance, which brought together more than 100 fact checkers in 
70+ countries in 40+ languages. These organizations have produced 9,000+ unique fact checks, all of which 
are accessible through a global fact-checking bot jointly created by the IFCN and WhatsApp. 


How do they make the information available? 


4. We're very cognizant of WhatsApp’s use among immigrant communities in the U.S. and we're focused on 
ensuring these sorts of resources noted above are available in Spanish as well as English. During the 
2020 election we partnered with Univision and Telemundo to make IFCN’s electiorn-related fact checks 
available in Spanish. Both Univision and Telemundo are now in the process of getting approved as certified 
IFCN fact checkers, which will enable them to set up their own Spanish-language fact checks directly on 
WhatsApp with financial support from Facebook. This will add to existing Spanish-language resources 
available via WhatsApp, including the search the web feature and the CoronaVirusFacts Alliance bot 
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mentioned above. 


Is this true in other languages? I'm thinking specifically about languages that have prevalence in south 
Asian countries. And in the electoral context, what did you do there that worked and you’re taking into this 
body of work? 


One other initiative we are focused on are partnerships with governments, private healthcare providers, and 
pharmactes to support COVID-19 vaccination efforts through chat tools on WhatsApp. We've launched these 
successfully so far in Indonesia, Brazil, South Africa, and Argentina, among other countries, and are very 
interested in exploring ways to replicate some of these efforts in the U.S., especially mn boosting the vaccination 
effort within the Latinx community. We are in discussions with the CDC and with officials in California, 
Delaware, and Los Angeles, and we are keen to work together to expand the scope and reach of these 
partnerships. 


| guess I have the same question here as | do on Facebook on Instagram. Do you guys think you have this 
under control? You're obviously going to say yes to that, so | quess the real question is, as ever: how are 
you measuring success? Reduction in forwarding? Measured impact across Facebook properties? 


Happy to schedule time to discuss any of this further. 
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From: HE <= THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251 CO920BB487E8111461E3692A624> 


To: Qureshi, Hoor EOP/WHO; Flaherty, Rob EOP/WHO 
Sent: 4/1/2021 8:00:08 PM 
Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


6 pm Monday is locked. Thanks. Will send other attendees. 


Get Outlook for 1OS 


From: Qureshi, Hoor EOP/WHO <2 wino cop. gov> 
Sent: Thursday, April 1, 2021 11:50:00 AM 

To: fb.com>: Flaherty, Rob EOP/WHO 4 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Mwho.eop.gov> 


Great! We can hold é6om. i could you pass along any other folks/their emails that should be included on the 
invite? 


Thanks! 


From: @fb.com> 
Sent: Thursday, April 1, 2021 11:45 AM 
To: Flaherty, Rob EOP/WHO 
Dwho.eop.gov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


who.eop.gov>; Qureshi, Hoor EOPAWHO 


Got it—we will lock in any time that works for Rob in the pm 


Get Outlook for iOS 


From: Flaherty, Rob EOP/WHO 6 10.200. gov> 


Sent: Thursday, April 1, 2021 11:13:33 AM 
10: AI to.com>. Qureshi, Joor EOP/WHO <{Owno.eop.gov> 


Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Meh actually | might not do that for now if we want to keep it small. 


From: Flaherty, Rob EOP/WHO 

Sent: Thursday, April 1, 2021 11:13 AM 

To: fb.com>; Qureshi, Hoor EOPAWHO <2 vito. cop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Monday's fine here! |'ll probably want to bring |e d fJjfrom our side with Andy coming if time allows. 


From: © f>.com> 

Sent: Thursday, April 1, 2021 10:13 AM 

To: Qureshi, Heor EOP/AWHO who.eop.gov> 

Cc: Flaherty, Rob EOP/WHO < @who.eop.gov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Checking wii anc [Jin my end. May make more sense to look at Monday slots too if all the same? 


Get Outlook for iOS 
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From: Qureshi, Hoor EOP/WHO <{ja.who.eop.gov> 


Sent: Thursday, April 1, 2021 9:38:13 AM 

To: A o.com 

Ce: Flaherty, Rob EOP/AWHO @who.eop.gov> 

Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Hi Would 5pm today work? Otherwise, may have to push this to early next week! 


Thanks, 
Hoor 


From: Flaherty, Rob EOP/WHO 
Sent: Thursday, April 1, 2021 9:27 AM 
To: fo.com> 


Cc: Qureshi, Hoor EOP/WHO SE 2 w''10.c0.gov> 


Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Ack sorry. Adding Hoor — tomorrow probably easier than today at this point (whichis my fault!} 


For: Ifo. com> 
Sent: Thursday, April 1, 2021 9:18 AM 

To: Flaherty, Rob EOP/WHO <(own'0.c00.cov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Just checking back here—we can also shoot for early next week if that’s easier at this point? 
Get Outlook for iOS 


From EE © t.com> 

Sent: Wednesday, March 31, 2021 11:58 AM 

To: Flaherty, Rob EOP/WHO 

Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


More shortly on other WA questions—but wanied to provide times — can we shoot for a window late afternoon (4 
or after) on either Thursday or Friday? 


Get Outlook for IOS 


From: Flaherty, Rob EOP/WHO RR 2 110.200. gov> 

Sent: Tuesday, March 30, 2021 7:35:08 PM 

To: fo.com> 

Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Responses in line! 


From: Si tb.com> 

Sent: Sunday, March 28, 2021 8:51 PM 

To: Flaherty, Rob EOP/WHO <B@ who.eop.gov> 

Subject: [EXTERNAL] Follow up from Friday meeting--additional context re: WWhatsApp 


Rob, 
Thanks again for meeting with us Friday. As discussed. we would love to set up some time with our research 
directo who could jon in our next meeting to brief you on our CMU Covid-19 Survey that 
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we shared a few weeks ago. Let us know if you're interested in covering that this week. 
All for it. Thursday better than Friday for me, Send some times over and we can coordinate. 


We also wanted to follow up on your questions about WhatsApp. I’m sure you're already attuned to this, but 
think it’s worth noting some of the key differences between a private messaging app like WhatsApp, and social 
media like Facebook and Instagram. Approximately 90 percent of the messages sent on WhatsApp are 
one-to-one, and the majority of group chats include fewer than ten people. WhatsApp does not promote content, 
and users do not build audiences or discover new people as they would on social media. 


Very aware &) 


You re right that without being able to see the content of messages on WhatsApp, we’re not able to measure 
prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to control the spread of 
misinformation and inform users through deliberate, content-agnostic product interventions -- things like labeling 
and limiting message forwards. The underlying idea there is that messages that did not originate from a close 
contact are less personal compared to typical messages sent on WhatsApp, and may be more prone to contain 
misinformation. The labels (*forwarded”: and “forwarded many times” if the message has been forwarded five 
times or more) are intended to prompt people to stop and think when they are reading a message and before they 
forward something, which may not be accurate. The forward limits (no more than five chats at time: one chat a 
time for highly forwarded messages), are intended to reduce their spread. As mentioned in my earlier note, when 
WhatsApp rolled out the limitation for highly forwarded messages to one chat at a time in April 2020, this 
resulted in a 70% reduction of those messages globally. Of course, not all forwards are misinformation, so these 
are by nature somewhat blunt tools, but they are important ones -- and ones that many other messaging services 
don’t provide. 


A few additional things to note: 


1. WhatsApp also employs best-in-class spam detection technology to spot accounts engaging in mass 
messaging behavior, so they can’t be used to spread spam or viral misinformation. We ban over 2 
million accounts per month for bulk messaging behavior, 75% of them without a recent user report, which 
means our automated systems stop abuse before users can report them. {This white paper describes these 
systems in further detail.) 


We have a thing where we can’t click links from emails — can you send me the white paper? 


2. Another aspect of what WhatsApp does -- again without accessing the content of messages -- is to provide 
tools to empower users to seek out reliable sources of information. One way we've done this in the 
product is through a “search the web” feature we rolled out last August, which allows users to easily double 
check highly forwarded messages they receive on WhatsApp by tapping a magnifying glass button in the 
chat to initiate a web search on their device browser. This helps users find news results or other sources of 
authoritative information about messages they have received from outside their close contacts -- and is 
available in English, Spanish, and other languages. 


Can you show me what this might look like? What kind of testing have you seen around effectiveness? Are 
there other tactics you've deployed? Does exposure to forwarded messages change in any way the kinds 
of positive information they’re exposed to on Facebook or Instagram? 


3. WhatsApp also has partnerships with fact checking organizations, government agencies, and international 
organizations, like the WHO, around the world to make authoritative information about COVID-19 and 
vaccines available via WhatsApp. WhatsApp donated $1M to the International Fact Checking Network 
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(IFCN) to support the CoronaVirusFacts Alliance, which brought together more than 100 fact checkers in 
70+ countries in 40+ languages. These organizations have produced 9,000+ unique fact checks, all of which 
are accessible through a global fact-checking bot jointly created by the IFCN and WhatsApp. 


How do they make the information available? 


4. We're very cognizant of WhatsApp’s use among immigrant communities in the U.S. and we're focused on 
ensuring these sorts of resources noted above are available in Spanish as well as English. During the 
2020 election we partnered with Univision and Telemundo to make IFCN’s electior-related fact checks 
available in Spanish. Both Univision and Telemundo are now in the process of getting approved as certified 
IFCN fact checkers, which will enable them to set up their own Spanish-language fact checks directly on 
WhatsApp with financial support from Facebook. This will add to existing Spanish-language resources 


available via WhatsApp, including the search the web feature and the CoronaVirusFacts Alliance bot 
mentioned above. 


Is this true in other languages? I’m thinking specifically about languages that have prevalence in south 


Asian countries. And in the electoral context, what did you do there that worked and you’ re taking into this 
body of work? 


One other initiative we are focused on are partnerships with governments, private healthcare providers, and 
pharmacies to support COVID-19 vaccination efforts through chat tools on WhatsApp. We've launched these 
successfully so far in Indonesia, Brazil, South Africa, and Argentina, among other countries, and are very 
interested in exploring ways to replicate some of these efforts in the U.S., especially in boosting the vaccination 
effort within the Latinx community. We are in discussions with the CDC and with officials in California, 
Delaware, and Los Angeles, and we are keen to work together to expand the scope and reach of these 
partnerships. 


| guess I have the same question here as | do on Facebook on Instagram. Do you guys think you have this 
under control? You're obviously going to say yes to that, so | quess the real question is, as ever: how are 
you measuring success? Reduction in forw arding? Measured impact across Facebook properties? 


Happy to schedule time to discuss any of this further. 
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Exhibit 19 


Email correspondence between 
Facebook and the White House 
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From: GS </ O= THEFACEBOOK/OU=EXTERNAL 
(FY DIBOHF25SPDLT)/CN=RECIPIENTS/CN=11F19CAE08CE44AD985D2E4840A683EC> 


To: Qureshi, Hoor EOP/WHO 

BCC: Fite aban] Flaherty, Rob EOP/WHO 

Sent: 4/13/2021 7:15:56 AM 

Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 
Rob/ {J to bec 


Good moming, Hoor! 


and team can accommodate 11am or 2pm ET tomorrow, Wed 4/14th, 
Please let me know if either of these options work for Rob. 


Thanks! 


From: Qureshi, Hoor EOP/WHO <i @who. cop. gov> 


Date: Saturday, April 10, 2021 at 6:18 PM 
To: ,  -& | Se Flaherty, Rob EOP/WHO < @who.eop. gov> 


Ce: fb.com> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Sure! What times work well on your end those days? 


From: <brianrice@fb.com> 
Sent: Saturday, April 10, 2021 5:31 PM 
To: Qureshi, Hoor EOP/WHO 
who.eop.gov> 

Ges @fb com> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


who.eop.gov>; Flaherty, Rob EOP/WHO 


Thanks Hoor—| think tough to do on Monday now—possible to shoot for Tuesday or Wednesday slots? 


From: Qureshi, Hoor EOP/VWWHO i @who. eop. gov> 

Date: Saturday, April 10, 2021 at 11:50 AM 

To: @fb.com>, Flaherty, Rob EOP/WHO <{J @who.cop.gov> 
Ce: fb.com> 

Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Hi (J! Sorry for the delay here. We could look at any time between 2-4pm for this, or 6pm? 


Let me know what works on your end. 


From: i SE @ fb.com> 

Sent: Thursday, April 8, 2021 4:09 PM 

To: Qureshi, Hoor EOP/WHO <i @who.eop.gov>; Flaherty, Rob EOP/WHO 
who.eop.gov> 


es s:>-- 
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Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Hi Hoor—we had ended our last chat by planning to put regular time on the calendar for Mondays (and then we can 
take down sessions if we don't have anything to cover). Can you help ID time that would work for Rob (and others 
as your team deems appropriate) for this coming Monday to follow up on our conversation from earlier this week? 


From: SS EEO! com> 


Date: Monday, April 5, 2021 at 1:06 PM 

To: Qureshi, Hoor EOP/WHO <i @who.eop.gov>, Flaherty, Rob EOP/WHO 
@who.eop.gov> 

Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


Hoor, 


Sorry for the delay—t’ll be joined by 6:00. 


GE is our research director and will plan to walk through the Covid survey. 


From: Qureshi, Hoor EOP/VWHO (| @who.eop. gov> 
Date: Thursday, April 1, 2021 at 11:50 AM 

To:  <G © .com>,, Flaherty, Rob EOP/WHO < 
Subject: RE: Follow up from Friday meeting--additional context 


@who.eop.gov> 


Great! We can hold 6pm. = could you pass along any other folks/their emails that should be included on the 
invite? 


Thanks! 


From: i BO f.com> 


Sent: Thursday, April 1, 2021 11:45 AM 

To: Flaherty, Rob EOP/WHO <{EEEEEEE @who.eop.gov>; Qureshi, Hoor EOP/WHO 
who.eop.gov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Got it—we will lock in any time that works for Rob in the pm. 


Get Outlook for iOS 


From: Flaherty, Rob EOP/WHO <{Qwho.eop.gov> 

Sent: Thursday, April 1, 2021 11:13:33 AM 

To: SS <I @ fb. com>; Qureshi, Hoor EOP/WHO <{Owno .cop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Meh actually | might not do that for now if we want to keep it small. 


From: Flaherty, Rob EOP/WHO 

Sent: Thursday, April 1, 2021 11:13 AM 

To: GS <M fb.com>: Qureshi, Hoor EOP/WHO <{@who.eop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Monday's fine here! !'ll probably want to bring [J and (i from our side with Andy coming if time allows. 


From: ES SEBO 1 com> 
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Sent: Thursday, April 1, 2021 10:13 AM 
To: Qureshi, Hoor EOP/WHO [EEE @who.eop.gov> 
Cc: Flaherty, Rob EOP/VVHO 9 @ who .eop.gov> 


Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 
Checking w | and J in my end. May make more sense to look at Monday slots too if all the same? 


Get Outlook for iOS 


From: Qureshi, Hoor EOP/WHO 
Sent: Thursday, April 1, 2021 9:38:13 AM 
To: fb.com> 


Ce: Flaherty, Rob EOP/WHO <I Qwho.cop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


who.eop.gov> 


Hi J! Would Spm today work? Otherwise, may have to push this to early next week! 


Thanks, 
Hoor 


From: Flaherty, Rob EOP/WHO 

Sent: Thursday, April 1, 2021 9:27 AM 

To: fb.com> 

Cc: Qureshi, Hoor EOP/WHO <i Qwho.eop.gov> 

Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Ack sorry. Adding Hoor — tomorrow probably easier than today at this point (whichis my fault!) 


From: fb.com> 

Sent: Thursday, April 1, 2021 9:18 AM 

To: Flaherty, Rob EOP/WHO SE Qwho.eop.gov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Just checking back here—we can also shoot for early next week if that’s easier at this point? 


Get Outlook for iOS 


From: i! SEEN O 1 com> 


Sent: Wednesday, March 31, 2021 11:58 AM 
To: Flaherty, Rob EOP/WHO 
Subject: Re: Follow up from Friday meeting--additional context re: VVhatsApp 


More shortly on other WA questions—but wanted to provide times — can we shoot for a window late afternoon (4 
or after) on either Thursday or Friday? 


Get Outlook for iOS 


From: Flaherty, Rob EOP/WHO <{@who.eop.gov> 

Sent: Tuesday, March 30, 2021 7:35:08 PM 

To: ES <I Of0.com> 

Subject: RE: Follow up from Friday meeting--additional context re: VWhatsApp 


Responses in line! 


From: i Bo fb.com> 
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Sent: Sunday, March 28, 2021 8:51 PM 


To: Flaherty, Rob EOP/WHO <i Qwho.eop.gov> 
Subject: [EXTERNAL] Follow up from Friday meeting--additional context re: WhatsApp 


Rob, 


Thanks again for meeting with us Friday. As discussed, we would love to set up some time with our research 
director i who could jon a in our next meeting to brief you on our CMU Covid-19 Survey that 
we shared a few weeks ago. Let us know if you’ re interested in covering that this week. 


All for it. Thursday better than Friday for me, Send some times over and we can coordinate. 


We also wanted to follow up on your questions about WhatsApp. I’m sure you're already attuned to this, but 
think it’s worth noting some of the key differences between a private messaging app like WhatsApp, and social 
media like Facebook and Instagram. Approximately 90 percent of the messages sent on WhatsApp are 
one-to-one, and the majority of group chats include fewer than ten people. WhatsApp does not promote content, 
and users do not build audiences or discover new people as they would on social media. 


Very aware () 


You're right that without being able to see the content of messages on WhatsApp, we're not able to measure 
prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to control the spread of 
misinformation and inform users through deliberate, content-agnostic product interventions -- things like labeling 
and limiting message forwards. The underlying idea there is that messages that did not originate from a close 
contact are less personal compared to typical messages sent on WhatsApp, and may be more prone to contain 
misinformation. The labels (“forwarded”; and “forwarded many times” if the message has been forwarded five 
times or more) are intended to prompt people to stop and think when they are reading a message and before they 
forward something, which may not be accurate. The forward limits (no more than five chats at time; one chat a 
time for highly forwarded messages), are intended to reduce their spread. As mentioned in my earlier note, when 
WhatsApp rolled out the limitation for highly forwarded messages to one chat at a time in April 2020, this 
resulted in a 70% reduction of those messages globally. Of course, not all forwards are misinformation, so these 
are by nature somewhat blunt tools, but they are important ones -- and ones that many other messaging services 
don’t provide. 


A few additional things to note: 


1. WhatsApp also employs best-in-class spam detection technology to spot accounts engaging in mass 
messaging behavior, so they can’t be used to spread spam or viral misinformation. We ban over 2 
million accounts per month for bulk messaging behavior, 75% of them without a recent user report, which 
means our automated systems stop abuse before users canreport them. (This white paper describes these 
systems in further detail.) 


We have a thing where we can’t click links from emails — can you send me the white paper? 


2. Another aspect of what WhatsApp does -- again without accessing the content of messages -- is to provide 
tools to empower users to seek out reliable sources of information. One way we've done this in the 
product is through a “search the web” feature we rolled out last August, which allows users to easily double 
check highly forwarded messages they receive on WhatsApp by tapping a magnifying glass button in the 
Chat to initiate a web search on their device browser. This helps users find news results or other sources of 
authoritative information about messages they have received from outside their close contacts -- and is 
available in English, Spanish, and other languages. 


243 


CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0009622 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Can you show me what this might look like? What kind of testing have you seen around effectiveness? Are 
there other tactics you’ve deployed? Does exposure to forwarded messages change in any way the kinds 
of positive information they’re exposed to on Facebook or Instagram? 


3. WhatsApp also has partnerships with fact checking organizations, government agencies, and international 
organizations, like the WWHO, around the world to make authoritative information about COVID-19 and 
vaccines available via WhatsApp. WhatsApp donated $1M to the International Fact Checking Network 
(IFCN) to support the CoronaVirusFacts Alliance, which brought together more than 100 fact checkers in 
70+ countries in 40+ languages. These organizations have produced 9,000+ unique fact checks, all of which 
are accessible through a global fact-checking bot jointly created by the IFCN and WhatsApp. 


How do they make the information available? 


4. We're very cognizant of WhatsApp’s use among immigrant communities in the U.S. and we’re focused on 
ensuring these sorts of resources noted above are available in Spanish as well as English. During the 
2020 election we partnered with Univision and Telemundo to make IFCN’s election-related fact checks 
available in Spanish. Both Univision and Telemundo are now in the process of getting approved as certified 
IFCN fact checkers, which will enable them to set up their own Spanish-language fact checks directly on 
WhatsApp with financial support from Facebook. This will add to existing Spanish-language resources 
available via WhatsApp, including the search the web feature and the CoronaVirusFacts Alliance bot 
mentioned above. 


Is this true in other languages? I’m thinking specifically about languages that have prevalence in south 
Asian countries. And in the electoral context, what did you do there that worked and you’re taking into this 
body of work? 


One other initiative we are focused on are partnerships with governments, private healthcare providers, and 
pharmacies to support COVID-19 vaccination efforts through chat tools on WhatsApp. We've launched these 
successfully so far in Indonesia, Brazil, South Africa, and Argentina, among other countries, and are very 
interested in exploring ways to replicate some of these efforts in the U.S., especially in boosting the vaccination 
effort within the Latinx community. We are in discussions with the CDC and with officials in California, 
Delaware, and Los Angeles, and we are keen to work together to expand the scope and reach of these 
partnerships. 


I guess | have the same question here as | do on Facebook on Instagram. Do you guys think you have this 
under control? You’re obviously going to say yes to that, so | guess the real question is, as ever: how are 
you measuring success? Reduction in forwarding? Measured impact across Facebook properties? 


Happy to schedule time to discuss any of this further. 
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Exhibit 20 


Internal Facebook email 
correspondence 
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I <0 =THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP (FYDIBOHF23SPDLT)/CN=RECIPIENTS 


/CN=801D8F2FABOF4236A38CD9150799E9DE 
To: 
Sent: 4/7/2021 5:44:31 PM 
Subject: Re: Top Entities / Enforcement 


Thanks for the heads up; | obviously agree with all of this. There is an underlying assumption that all of these entities are bad (and some of them are, I’m 
sure) but even some of the 38 Disinfo Dozen entities were completely benign. To really push farther than what we have already done would likely be out 
of the misinfo realm, since vaccine hesitancy is often or mostly not misinfo. A fewideas that come to mind: 

e Major change to DVDE: Only require 1 CS strike and lower the amount of B2V required 

e DVDE but without any CS strike requirement 

e Make B2V part of the Community Standards 


The last one is the nuclear option but also the one most likely to have a meaningful impact. 


From: i of) .com> 


Date: Wednesday, April 7, 2021 at 5:59 PM 


10: es ©¢> com>, TS © ().con>, iE 3 Ab.com> 


Subject: Re: Top Entities / Enforcement 


| think it would be something like that *but | also feel it's fair for us to really push leadership (or Partnerships to channel external feedback) on what they 
believe is problematic about these Pages. | think it’s that these people are vaccine hesitant, and they drive traffic to their off platform webpages. But 
before we explore a policy around this we should be sure we agree in principle we find this problematic. | don’t personally understand why we're leaning 
into the research that suggests vaccine hesitancy needs to be met with education/information/sensitivity and also still beating on the “remove more” 
drum. 


From: fb.com> 
Date: Wednesday, April 7, 2021 at 2:53 PM 


To: (or ES o> o> | 5.com> 


Subject: Re: Top Entities / Enforcement 


Thanks for flagging. VWWould our next policy option basically be the DVDE policy, but without requiring CS strikes as a check? Wondering if it’s helpful to 
have ops run that test on the “problematic” entities we haven't removed (when they get it) to understand the impact. 


From: iT of) .com> 


Date: Wednesday, April 7, 2021 at 2:35 PM 


To! (o>, ES cn IN 2.com> 


Subject: FW: Top Entities / Enforcement 
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ibn ma. FYI we may be asked to do even further policy development on vaccine hesitancy entities. | see ball in other teams’ court right now -- ie 
Ops/Product/Partnerships need to get us a list of “problematic” entities we haven't removed, [IIE cods to send us the TPs she’s drafting as to why 
"m sure we'll need to provide input though foundation is the work BM already done), and then we can get leadership steer on whether they want 


(a 
us OCP to come up with options to address the perceived “gaps.” Will keep you posted on how this convo withliplays out. 


From: fb.com> 
Date: Wednesday, April 7, 2021 at 2:29 PM 


fb.com>, Ofb.com>, 
.com>, @fb.com>, @fb.com>, 


fb.com>; fb.com>, iii 


fb.com>, jcantarella@fb.com> 


m>, 
fb 


From: 
Sent: Wednesday, April 7, 2021 2:04 PM 


cr? i > on; i ¢) con 


Subject: Re: Top Entities / Enforcement 


Thanks, would be good to meet to discuss. What is the right group? SR, Comms, Partnerships, Policy, and Product? 
Here’s what | think the situation is (LMK if my summary is incorrect). 


1) We were under intense criticism (including from WHO and US Government) to remove “superspreading” vaccine hesitancy entities in January—to the 
point where it was overshadowing our ability to engage with partners on proactive work. This was primarily driven by 2 lists of <500 such entities from 
external reporting (one from CCDH, one from NewsGuard). 

2) Inresponse, we announced updated policies in late January/early February and committed to removing more of these entities over time (and did an 
initial batch of removals in February). This helped reset some of the relationships, but these partners are/were expecting meaningful progress. 

3) It's now April. We don't actually know how many of these entities we’ve removed, but we believe it’s the minority. We have a new policy (DVDE) 
landing; but, we don't know how many additional entities will get removed under this policy, and we also believe it’ll be the minority. 

4) At the same time, we're starting to get growing external criticism about how slowly we’ve been implementing our updated policies (for example 
was asked : ta few <¢ 2 US congressional testimony in late March; similarly WHO sent to us an article last week). 

5) Given the above, it seems valuable to: 
a) Understand how many of the above entities are have removed or are on track to being removed; 

b) For the ones we are not on track to remove, determine whether we feel like our position is defensible to partners (in which case we should arm 
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Comms/Pships with clear talking points); or whether we should entertain additional options on substance (in which case we should tee these up). 
6) My instinct is understanding this sooner vs. later is important, otherwise we may risk a repeat of the January escalations/have a setback in our external 
narrative and partner relationships, among other things. 


From: fb.com> 
Sent: Wednesday, March 31, 2021 5:05 PM 


fb.com>; fb.com>; iE fb.com>; 
: @fb.com>; fb.com> 


Subject: Re: Top Entities / Enforcement 


| & | Know you're on vacation this week so let me know if | should set up some time to discuss when you're back. 


Sent from my iPhone 


On Mar 31, 2021, at 7:35 PM, EE fb.com> wrote: 
Hi 


So far we’ve found most of the accounts associated with the CCDH “dirty dozen’ do not violate our status quo policies and won't come down under our 
DVDE policy. Our goal in developing the DVDE policy was to create a policy to take down entities dedicated to spreading vaccine misinfo. What we're 
observing is these high profile entities, who are sophisticated actors, seem to have changed their behaviors, or at least do not now seem to be sharing 
much explicit vaccine misinformation and vaccine discouraging content on platform. We're looking to pull some examples of entities that will come down 
to make a stronger case for the impact of the policy, but we may have to defend that we’ve seen a behavior change and these entities are not spreading 
the content perceived as problematic on our platforms to the extent people believe this is happening. 


Very glad to discuss further if it would help. 
iri 


From: fb.com> 
Date: Wednesday, March 31, 2021 at 11:06 AM 


fb.com>, a 


Subject: Re: Top Entities / Enforcement 
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Thanks | & totally understand where you are coming from. Adding | i Ghee who are overseeing the analysis and can help answer 
these questions further. 


On 1 — my understanding of the ongoing review that{iis overseeing is related to the 12 individuals that were flagged by CCDH which is actually 
associated with roughly 37 entities. 


On 2 — DVDE is expected to launch this Friday. A set of entities are going to get notice that our rules have changed and then enforcement starts April 5 
on escalation only and English only. Over the coming weeks we will expand to market FTEs and roll out in more languages. 


As you know if they are posting vaccine hesitancy content, it is not removeable under current policies at the individual content level. The DVDE policy as 
it stands today is based on entities having previous misinfo strikes in addition to posting majority vaccine hesitancy content so the bar is high. Also, in 
terms of trends — my understanding is the main thing we are seeing is these entities posting to off platform sites and not actually posting vaccine 
hesitancy on platform which is why many aren't coming down (and may not unless the criteria for DVDE changes). 


I'll let TE weian in and then if we need — I’m happy to set up a call for us all to discuss further if that works! 


From: Eo %b com> 


Date: Wednesday, March 31, 2021 at 1:21 PM 


To: fb.com> fb.com> 
fb.com>, fb.com>, ee of). com> 


Ce: 
Subject: Re: Top Entities / Enforcement 


Awesome, thank you! 


1) When will we have this for the CCDH list, and is it just for the 12 entities or the bigger set they flagged in December? 
2) When will DVDE be launched / will we have the broader analysis done? 


The reason I'm pushing a bit on this is that | think one of the biggest things in both substance and legitimacy here is removing these 
large superspreaders. As you know this was one of the main things you helped us align on with in January-and from an 
Offense perspective, this continues to be a headwind in our ability to engage with key partners and build trust. 


Given that it's now 2 months since we announced our first actions here and it seems like our enforcement has not met external 
expectations (or my own internal ones), | think it'd be extremely helpful to know whether we're on track to get there by end of April. 


For me, "on track" means substantial % of the things in these lists are taken down + Comms/Pships/Public Policy feels good about 
defending the ones we do not. If we're not "on track", | think valuable to tee that up in the next week or two so people aren't surprised, 
and so we can make an explicit decision to close (or to not close) faster. | think this will also help us get to a clearer shared 
understanding of "on track". 
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Thanks, 


From: fb.com> 


Sent: Wednesday, March 31, 2021 8:43 AM 

To fb.com>; fb.com> 

Ce: fb.com>: @fb.com>; 2 fb.com> 
Subject: Re: Top Entities / Enforcement 

Hi - 


Def agree this would be helpful. We are working on something like this for the CCDH list. And then for the larger list we can work to get something like 
this going but | think it would be most helpful to evaluate once the DVDE entities policy has launched are more entities will likely come down. Bandwidth 
is pretty constrained right now but we will definitely work to get something like this as it would absolutely be useful! 


From: fb.com> 
Date: Monday, March 29, 2021 at 1:45 PM 


@fb.com>, fb.com> 
@fb.com>| fb.com>, Ob .com> 


Subject: Top Entities / Enforcement 


Following up on what you flagged to me as part of narrative prep: 


To: 
Ce: 


Is there a way we can quantify how many of the NewsGuard and CCDH (January Disinfo Dozen + Dec report that references 425 
entities + earlier report that profiles a lot of them) entities have been removed to date, and, of the ones that remain, which we expect to 
be removed by ~mid April (given the new policy updates) vs. which will remain up? 


Something like a list of accounts with the below. 
[Account] / [FB; or IG] / [Removed; or Up: Likely to Be Removed; or Up: Unlikely to Be Removed] / [# of Followers] 


| think having this list would be super helpful in getting everyone to shared state to then inform further discussions (e.g. if we think vast 
majority will be removed in a few weeks and the remainder are defensible, that's very different than if the vast majority will still remain 
up even after the latest policy update). 

| think it total we're talking about <500 entities total, 12 of which | think ves asked about in testimony last week. 

Thanks, 
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From: </O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 


/CN=70251C0920BB487E8111461E3692A624> 


To: iw ho.eop.gov 

Sent: 4/9/2021 11:15:53 AM 

Subject: Follow up--WA responses 

Attachments: IFCN Chatbot.png; Search the Web.png; Stopping-Abuse-white-paper. pdf; WHO Health Alert.png 


Hi Rob. 


Wanted to follow up on vour additional questions about WhatsAp -- responses to your questions 
embedded in line and in blue below, along with a few attachments that are discussed in-line. Happy 
to discuss further. 


Also—happy to schedule our next session with for Monday if you're interested. I know she 
was hoping to bring her colleague [to brainstorm on some ideas with you and Courtney. We can 
do this Monday or anytime next week. 


Thanks, 


We also wanted to follow up on your questions about WhatsApp. I’m sure you're already attuned to 
this, but think it’s worth noting some of the key differences between a private messaging app like 
WhatsApp, and social media like Facebook and Instagram. Approximately 90 percent of the 
messages sent on WhatsApp are one-to-one, and the majority of group chats include fewer than ten 
people. WhatsApp does not promote content, and users do not build audiences or discover new 
people as they would on social media. 


Very aware ©) 


You're right that without being able to see the content of messages on WhatsApp, we're not able to 
measure prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to 
control the spread of misinformation and inform users through deliberate, content-agnostic product 
interventions - things Itke labeling and limiting message forwards. The underlying idea there is that 
messages that did not originate from a close contact are less personal compared to typical messages 
sent on WhatsApp, and may be more prone to contain misinformation. The labels (*forwarded™; and 


253 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0008923 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


“forwarded many times” if the message has been forwarded five times or more) are intended to 
prompt people to stop and think when they are reading a message and before they forward 
something, which may not be accurate. The forward limits (no more than five chats at time: one chat 
a time for highly forwarded messages), are intended to reduce their spread. As mentioned in my 
earlier note, when WhatsApp rolled out the limitation for highly forwarded messages to one chat at a 
time in April 2020, this resulted in a 70% reduction of those messages globally. Of course, not all 
forwards are misinformation, so these are by nature somewhat blunt tools, but they are tmportant 
ones -- and ones that many other messaging services don't provide. 


A few additional things to note: 


a WhatsApp also employs best-in-class spam detection technology to spot accounts 
engaging in mass messaging behavior, so they can’t be used to spread spam or viral 
misinformation. We ban over 2 million accounts per month for bulk messaging behavior, 
75% of them without a recent user report, which means our automated systems stop abuse 
before users can report them. {This white paper describes these systems in further detail.) 


We have a thing where we can't click links from emails - can you send me the white paper? 


White Paper is attached in PDF to this email. 


2, Another aspect of what WhatsApp does -- again without accessing the content of messages -- 
is to provide tools to empower users to seek out reliable sources of information. One way we've done 
this in the product is through a “search the web” feature we rolled out last August, which allows users to 
easily double check highly forwarded messages they receive on WhatsApp by tapping a magnifying glass 
button in the chat to initiate a web search on their device browser. This helps users find news results or 
other sources of authoritative information about messages they have received from outside their close 
contacts -- and is available in English, Spanish, and other languages. 


Can you show me what this might look like? What kind of testing have vou seen around 
effectiveness? Are there other tactics you've deployed? Does exposure to forwarded messages 
change in any way the kinds of positive information they're exposed to on Facebook or 
Instagram? 


Attached is an image explaining how “Search the Web” functions on WhatsApp - and vou 

> Zlang=en. As we 
have rolled out Search the Web over the past vear. we have conducted research - through 
interviews and survevs - to understand how users interact with this feature, what level of 
awareness they have about it and particularly, how it is used by low digital literacy users. 
Along similar lines, we are continuing to experiment with different forward depths that 
classify a message as a“ Highly Forwarded Message” and bring up the magnifVing glass 
button for that message. We will use these insights to design further product features that 
limit virality on WhatsApp. 
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With respect to vour question about COV1D-related information people may be exposed to 
Facebook and Instagram. that is not related to users’ personal messaging activity on 
WhatsApp. 


° 


Lo WhatsApp also has partnerships with fact checking organizations, government agencies, and 
international organizations, like the WHO, around the world to make authoritative information about 
COVID-19 and vaccines available via WhatsApp. WhatsApp donated $1M to the International Fact 
Checking Network (IFCN) to support the Corona VirusFacts Alliance, which brought together more than 
100 fact checkers in 70+ countries in 40+ languages. These organizations have produced 9,000+ unique 
fact checks, all of which are accessible through a global fact-checking bot jointly created by the IFCN and 
WhatsApp. 


How do they make the information available? 


COVID-19 information is made available on WhatsApp by WHO, government health 
ministries. and third-party fact checkers through our WhatsApp Business APE solution, which 
supports two-way conversational messaging and one-way notifications. These organizations 
access our APE through approved business solutions providers (BSPs) to build chatbots on the 
WhatsApp Business APE that are capable of returning automated responses to user queries. 
We support government partners by watving WhatsApp fees associated with the APE and 
making available Facebook ads credits to publicize these chatbots. For some fact checkers, 
we cover the BSP and end client costs through annual grants. 


Users click on a link on the organization’s website to open the chat or text “hi to the 
chatbot’s phone number. This brings them to a greeting messayze where they are presented 
with options to search for information on a COVID-related topic. access latest fact checks, or 
vet tips to fight misinformation, among other things. The requested information is then 
provided in a variety of ways. 


The WHO Health Alert on WhatsApp, for example. provides information about how vaccines 
work and how they are tested as a text messaye in response to a user query. It also provides 
users with links to videos of WHO's “Scverce #3 series where scientists discuss commonly 
asked questions about the Covid-19 Vaccines. The latest edition of this discussion is also sent 
to the user’s chat as an audio clip for ease of access. 


The FON chatbot which leverages the Corona VirusFacts Alhance database of COVID-19 
misinformation allows users to search for fact checks based on keywords and will provide the 
latest fact-checks from networks in the user’s country as determined bv the user's phone 
number. 


Screenshots of the WHO Health Alert and IFCN chatbot are attached. 


4. We're very cognizant of WhatsApp’s use among immigrant communities in the U.S. and 
we're focused on ensuring these sorts of resources noted above are available in Spanish as well as 
English. During the 2020 election we partnered with Univision and Telemundo to make IFCN’s election- 
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related fact checks available in Spanish. Both Univision and Telemundo are now tn the process of getting 
approved as certified IFCN fact checkers, which will enable them to set up their own Spanish-language fact 
checks directly on WhatsApp with financial support from Facebook. This will add to existing Spanish- 
language resources available via WhatsApp, including the search the web feature and the 

Corona VirusFacts Alliance bot mentioned above. 


Is this true in other languages? I'm thinking specifically about languages that have prevalence 
in south Asian countries, And in the electoral context, what did vou do there that worked and 
you're taking into this body of work? 


We encourage our partners to make their resources available as widely as possible. The IFCN 
Corona VirusFacts Alliance chatbot is already available in the US in 4 languages - English, Hindi, 
Spanish and Portuguese. The Search the Web feature is currently available in English, Spanish, 
German, Italian and French: we have been working to expand the feature and it’s available to 
South Asian language markets in Android Beta (-25M users) but the quality of search results is not 
vet high enough for a full launch. 


US 2020 was the biggest fact checking effort that WhatsApp supported and we're pleased that 
these efforts have helped to spur progress in the broader fact checking ecosystem. The 
partnerships we built with Telemundo and Univision, helped lead to both companies establishing 
their own specialized Spanish-language fact checking units - A/. Defector and 1 Lerifice, 
respectively - and hiring data analysts and translators to aid their fact checking efforts. 


We are also proud of the work that we did with IFCN during the US 2020 election to help create a 
consortium of fact checkers, which allowed these organizations to pool resources and scale their 
operations. We have been building on the success of this model elsewhere in the world - including 
in India where we have worked with six Indian fact checking organizations to build a similar 
coalition that will consolidate fact checks and trends on a common website. 


One other initiative we are focused on are partnerships with governments, private healthcare 
providers, and pharmacies to support COVID-19 vaccination efforts through chat tools on 
WhatsApp. We've launched these successfully so far in Indonesia, Brazil, South Africa, and 
Argentina, among other countries, and are very interested in exploring ways to replicate some of 
these efforts in the U.S., especially in boosting the vaccination effort within the Latinx community. 
We are in discussions with the CDC and with officials in Calrfornia, Delaware, and Los Angeles, and 
we are keen to work together to expand the scope and reach of these partnerships. 


I guess I have the same question here as [do on Facebook on Instagram. Do vou guys think vou 
have this under control? You're obviously going to say ves to that, so I guess the real question 
is, as ever: how are you measuring success? Reduction in forwarding? Measured impact across 
Facebook properties? 


On WhatsApp. reduction in forwards is just one of the signals that we use to measure how 
well we are doing in reducing viral activity on our platform. We also ban accounts that 
engage in mass marketing or scam behaviors - including those that seek to exploit 
COVID-19 misinformation. Our efforts in this space are more comprehensive than anything 
that our peers in private messaging or SMS do, and we are constantly innovating to stay 
ahead of future challenges. 
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We also track engagement with some of the tools available on WhatsApp that provide 
access to fact checks and other authoritative sources of information. For instance, 3 billion 
messages related to COVID-19 have been sent by governments. nonprofits and international 
organizations to citizens through official WhatsApp chatbots, and over 300 million messages 
have been sent over COVID-19 vaccine helplines on WhatsApp during the Ist quarter of 
2021. 
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From: GE <= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO 
Sent: 4/10/2021 2:33:25 PM 
Subject: Re: Follow up--WA responses 


Understood. | thought we were doing a better job through {J responding to this - and we are working to get 
the data that will more clearly show the universe of the Covid content that’s highest in distribution with a clear 
picture of what percentage of that content is vax hesitancy content, and how we are addressing it. | know Nick told 
Andy that would take a bit of time to nail down and we are working on that universe of data. | will make sure we're 
more clearly responding to your questions below. 


From: Flaherty, Rob EOP/WHO <{ @who. cop. gov> 
Date: Friday, April 9, 2021 at 2:56 PM 

To: EE SEO. com> 

Subject: RE: Follow up--WA responses 


Thanks for this, jj. Hoor should be trying to land a time. 


Will say I'm really mostly interested in what effects the interventions and products you've tested have had on 
increasing vaccine interest within hesitant communities, and which ones have shown promise. Really couldn't care 
less about products unless they’re having measurable impact. And while the product safari has been interesting, at 
the end of the day, | care mostly about what actions and changes you're making to ensure sure you're not making 
Our country’s vaccine hesitancy problem worse. | definitely have what | believe to be a non-comprehensive list of 
products you're building but | still don’t have a good, empirical answer on how effective you've been at reducing the 
spread of vaccine-skeptical content and misinformation to vaccine fence sitters in the now-folded “lockdown.” If 
GB can speak to those things, oreat. J hasn't been able to, but I'm sure someone there can. 


In the electoral context, you tested and deployed an algorithmic shift that promoted quality news and information 
about the election. This was reported in the New York Times and also readily apparent to anyone with cursory 
social listening tools. You only did this, however, after an election that you helped increase skepticism in, and an 
insurrection which was plotted, in large part, on your platform. And then you turned it back off. | want some 
assurances, based in data, that you are not doing the same thing again here. 


From: Si BO fb.com> 
Sent: Friday, April 9, 2021 2:16 PM 


To: Flaherty, Rob EOP/WHO <{ Qwho.eop.gov> 
Subject: [EXTERNAL] Follow up--WA responses 


Hi Rob, 


Wanted to follow up on your additional questions about WhatsAp -- responses to your questions 
embedded in line and in blue below, along with a few attachments that are discussed in-line. Happy 
to discuss further. 
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Also—happy to schedule our next session with a for Monday if you’re interested. I know she 
was hoping to bring her colleague [J to brainstorm on some ideas with you and i. We can 
do this Monday or anytime next week. 


Thanks, 


We also wanted to follow up on your questions about WhatsApp. I’m sure you’re already attuned to 
this, but think it’s worth noting some of the key differences between a private messaging app like 
WhatsApp, and social media like Facebook and Instagram. Approximately 90 percent of the 
messages sent on WhatsApp are one-to-one, and the majority of group chats include fewer than ten 
people. WhatsApp does not promote content, and users do not build audiences or discover new 
people as they would on social media. 


Very aware ‘) 


You're right that without being able to see the content of messages on WhatsApp, we’re not able to 
measure prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to 
control the spread of misinformation and inform users through deliberate, content-agnostic product 
interventions -- things like labeling and limiting message forwards. The underlying idea there is that 
messages that did not originate from a close contact are less personal compared to typical messages 
sent on WhatsApp, and may be more prone to contain misinformation. The labels (“forwarded”, and 
“forwarded many times” if the message has been forwarded five times or more) are intended to 
prompt people to stop and think when they are reading a message and before they forward 
something, which may not be accurate. The forward limits (no more than five chats at time; one chat 
a time for highly forwarded messages), are intended to reduce their spread. As mentioned in my 
earlier note, when WhatsApp rolled out the limitation for highly forwarded messages to one chat at a 
time in April 2020, this resulted in a 70% reduction of those messages globally. Of course, not all 
forwards are misinformation, so these are by nature somewhat blunt tools, but they are important 
ones -- and ones that many other messaging services don’t provide. 


A few additional things to note: 


a WhatsApp also employs best-in-class spam detection technology to spet accounts 
engaging in mass messaging behavior, so they can’t be used to spread spam or viral 
misinformation. We ban over 2 million accounts per month for bulk messaging behavior, 
75% of them without a recent user report, which means our automated systems stop abuse 
before users can report them. (This white paper describes these systems in further detail.) 
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We have a thing where we can’t click links from emails — can you send me the white paper? 


White Paper is attached in PDF to this email. 


2. Another aspect of what WhatsApp does -- again without accessing the content of messages -- 
is to provide tools to empower users to seek out reliable sources of information. One way we’ ve done 
this in the product is through a “search the web” feature we rolled out last August, which allows users to 
easily double check highly forwarded messages they receive on WhatsApp by tapping a magnifying glass 
button in the chat to initiate a web search on their device browser. This helps users find news results or 
other sources of authoritative information about messages they have received from outside their close 
contacts -- and is available in English, Spanish, and other languages. 


Can you show me what this might look like? What kind of testing have you seen around 
effectiveness? Are there other tactics you’ve deployed? Does exposure to forwarded messages 
change in any way the kinds of positive information they’re exposed to on Facebook or 
Instagram? 


Attached is an image explaining how “Search the Web” functions on WhatsApp - and you 
can find more info at this link: >https://blog. whatsapp:com/search-the-web/?lang=en<. As 
we have rolled out Search the Web over the past year, we have conducted research - 
through interviews and surveys - to understand how users interact with this feature, what 
level of awareness they have about it and particularly, how it is used by low digital literacy 
users. Along similar lines, we are continuing to experiment with different forward depths 
that classify a message as a “Highly Forwarded Message” and bring up the magnifying glass 
button for that message. We will use these insights to design further product features that 
limit virality on WhatsApp. 


With respect to your question about COVID-related information people may be exposed to 
Facebook and Instagram, that is not related to users’ personal messaging activity on 
WhatsApp. 


3: WhatsApp also has partnerships with fact checking organizations, government agencies, and 
international organizations, like the WHO, around the world to make authoritative information about 
COVID-19 and vaccines available via WhatsApp. WhatsApp donated $1M to the International Fact 
Checking Network (IFCN) to support the Corona VirusFacts Alliance, which brought together more than 
100 fact checkers in 70+ countries in 40+ languages. These organizations have produced 9,000+ unique 
fact checks, all of which are accessible through a global fact-checking bot jointly created by the IFCN and 
WhatsApp. 


How do they make the information available? 


COVID-19 information is made available on WhatsApp by WHO, government health 
ministries, and third-party fact checkers through our WhatsApp Business API solution, which 
supports two-way conversational messaging and one-way notifications. These organizations 
access our API through approved business solutions providers (BSPs) to build chatbots on the 
WhatsApp Business API that are capable of returning automated responses to user queries. 
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We support government partners by waiving WhatsApp fees associated with the API and 
making available Facebook ads credits to publicize these chatbots. For some fact checkers, 
we cover the BSP and end client costs through annual grants. 


Users click on a link on the organization’s website to open the chat or text “hi” to the 
chatbot’s phone number. This brings them to a greeting message where they are presented 
with options to search for information on a COVID-related topic, access latest fact checks, or 
get tips to fight misinformation, among other things. The requested information is then 
provided in a variety of ways. 


The WHO Health Alert on WhatsApp, for example, provides information about how vaccines 
work and how they are tested as a text message in response to a user query. It also provides 
users with links to videos of WHO’s “Science in 3° series where scientists discuss commonly 
asked questions about the Covid-19 Vaccines. The latest edition of this discussion is also sent 
to the user’s chat as an audio clip for ease of access. 


The IFCN chatbot which leverages the Corona VirusFacts Alliance database of COVID-19 
misinformation allows users to search for fact checks based on keywords and will provide the 
latest fact-checks from networks in the user’s country as determined by the user’s phone 
number. 


Screenshots of the WHO Health Alert and IFCN chatbot are attached. 


4. We’re very cognizant of WhatsApp’s use among immigrant communities in the U.S. and 
we're focused on ensuring these sorts of resources noted above are available in Spanish as well as 
English. During the 2020 election we partnered with Univision and Telemundo to make IFCN’s election- 
related fact checks available in Spanish. Both Univision and Telemundo are now in the process of getting 
approved as certified IFCN fact checkers, which will enable them to set up their own Spanish-language fact 
checks directly on WhatsApp with financial support from Facebook. This will add to existing Spanish- 
language resources available via WhatsApp, including the search the web feature and the 

Corona VirusFacts Alliance bot mentioned above. 


Is this true in other languages? I'm thinking specifically about languages that have prevalence 
in south Asian countries. And in the electoral context, what did you do there that worked and 
you’re taking into this body of work? 


We encourage our partners to make their resources available as widely as possible. The IFCN 
Corona VirusFacts Alliance chatbot is already available in the US in 4 languages - English, Hindi, 
Spanish and Portuguese. The Search the Web feature is currently available in English, Spanish, 
German, Italian and French; we have been working to expand the feature and it’s available to 
South Asian language markets in Android Beta (~25M users) but the quality of search results is not 
yet high enough for a full launch. 


US 2020 was the biggest fact checking effort that WhatsApp supported and we’ re pleased that 
these efforts have helped to spur progress in the broader fact checking ecosystem. The 
partnerships we built with Telemundo and Univision, helped lead to both companies establishing 
their own specialized Spanish-language fact checking units - EL Defector and T Verifica, 
respectively - and hiring data analysts and translators to aid their fact checking efforts. 
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We are also proud of the work that we did with IFCN during the US 2020 election to help create a 
consortium of fact checkers, which allowed these organizations to pool resources and scale their 
operations. We have been building on the success of this model elsewhere in the world - including 
in India where we have worked with six Indian fact checking organizations to build a similar 
coalition that will consolidate fact checks and trends on a common website. 


One other initiative we are focused on are partnerships with governments, private healthcare 
providers, and pharmacies to support COVID-19 vaccination efforts through chat tools on 
WhatsApp. We’ve launched these successfully so far in Indonesia, Brazil, South Africa, and 
Argentina, among other countries, and are very interested in exploring ways to replicate some of 
these efforts in the U.S., especially in boosting the vaccination effort within the Latinx community. 
We are in discussions with the CDC and with officials in California, Delaware, and Los Angeles, and 
we are keen to work together to expand the scope and reach of these partnerships. 


I guess I have the same question here as I do on Facebook on Instagram. Do you guys think you 
have this under control? You’re obviously going to say yes to that, so I guess the real question 
is, as ever: how are you measuring success? Reduction in forwarding? Measured impact across 
Facebook properties? 


On WhatsApp, reduction in forwards is just one of the signals that we use to measure how 
well we are doing in reducing viral activity on our platform. We also ban accounts that 
engage in mass marketing or scam behaviors - including those that seek to exploit 
COVID-19 misinformation. Our efforts in this space are more comprehensive than anything 
that our peers in private messaging or SMS do, and we are constantly innovating to stay 
ahead of future challenges. 


We also track engagement with some of the tools available on WhatsApp that provide 
access to fact checks and other authoritative sources of information. For instance, 3 billion 
messages related to COVID-19 have been sent by governments, nonprofits and international 
organizations to citizens through official WhatsApp chatbots, and over 300 million messages 
have been sent over COVID-19 vaccine helplines on WhatsApp during the Ist quarter of 
2021. 
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From: GN </0=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Qureshi, Hoor EOP/WHO 
Sent: 4/12/2021 4:09:42 PM 
Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


Sorry for delay Hoor—working to get you windows for Wednesday afternoon that work for our product leads. Be 
back shortly to confirm. 


From: Qureshi, Hoor EOP/WHO <I @who.eop. gov> 
Date: Saturday, April 10, 2021 at 6:18 PM 


To: @fb.com>, Flaherty, Rob EOP/WHO <i Q@who. eop. gov> 
Ce: fb.com> 


Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Sure! What times work well on your end those days? 


From: fb.com> 

Sent: Saturday, April 10, 2021 5:31 PM 

To: Qureshi, Hoor EOP/WHO <i @ who.cop.gov>; Flaherty, Rob EOP/WHO 
who.eop.gov> 

Ce: fb.com> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Thanks Hoor—! think tough to do on Monday now—possible to shoot for Tuesday or Wednesday slots? 


From: Qureshi, Hoor EOP/WHO <Hoor. Qureshi@who.eop.gov> 
Date: Saturday, April 10, 2021 at 11:50 AM 


To: © fb.com>, Flaherty, Rob EOP/WHO <Q @who. cop. gov> 
Cc: i (> .com> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Hi Brian! Sorry for the delay here. We could look at any time between 2-4pm for this, or 6pm? 


Let me know what works on your end. 


From: fb.com> 

Sent: Thursday, April 8, 2021 4:09 PM 

To: Qureshi, Hoor EOP/WHO <{@ who.eop.gov>; Flaherty, Rob EOP/WHO 
who.eop.gov> 

Ce: fb.com> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Hi Hoor—we had ended our last chat by planning to put regular time on the calendar for Mondays (and then we can 
take down sessions if we don’t have anything to cover). Can you help ID time that would work for Rob (and others 
as your team deems appropriate) for this coming Monday to follow up on our conversation from earlier this week? 


From: iE Ofb.com> 

Date: Monday, April 5, 2021 at 1:06 PM 

To: Qureshi, Hoor EOP/WHO <i @who. cop. gov>, Flaherty, Rob EOP/WHO 
@who.eop.gov> 
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Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


Hoor, 


Sorry for the delay—I'l be joined by i! i). I 2c IIE 2t 6:00. 
Curtiss is our research director and will plan to walk through the Covid survey. 


From: Qureshi, Hoor EOP/WHO J Qwho. cop. gov> 
Date: Thursday, April 1, 2021 at 11:50 AM 


To: SE @ > .com>, Flaherty, Rob EOP/WHO <i Qwho. cop. gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Great! We can hold 6pm. Brian, could you pass along any other folks/their emails that should be included on the 
invite? 


Thanks! 


From: (iO fb.com> 

Sent: Thursday, April 1, 2021 11:45 AM 

To: Flaherty, Rob EOP/WHO <i Qwho.eop.gov>; Qureshi, Hoor EOP/WHO 
who.eop.gov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Got it—we will lock in any time that works for Rob in the pm. 


Get Outlook for iOS 


From: Flaherty, Rob EOP/WHO <Y @who.eop.gov> 

Sent: Thursday, April 1, 2021 11:13:33 AM 

To: © fo.com>; Qureshi, Hoor EOP/WHO <fOwno.eop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Meh actually | might not do that for now if we want to keep it small. 


From: Flaherty, Rob EOP/WHO 

Sent: Thursday, April 1, 2021 11:13 AM 

To: EO fb.com>; Qureshi, Hoor EOP/WHO <{@who.eop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Monday's fine here! I'll probably want to bring J and fj from our side with Andy coming if time allows. 


From: fb.com> 
Sent: Thursday, April 1, 2021 10:13 AM 
To: Qureshi, Hoor EOP/WHO <i @who.eop.gov> 


Cc: Flaherty, Rob EOP/WHO <{ Qwho.eop.gov> 
Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Checking w {J and QJ in my end. May make more sense to look at Monday slots too if all the same? 


Get Outlook for iOS 


From: Qureshi, Hoor EOP/WHO <i @who.eop.gov> 


266 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0009491 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Sent: Thursday, April 1, 2021 9:38:13 AM 
To: IO fo.com> 


Cc: Flaherty, Rob EOP/WHO <I Qwho.eop.gov> 
Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Hi SJ! Would 5pm today work? Otherwise, may have to push this to early next week! 


Thanks, 
Hoor 


From: Flaherty, Rob EOP/WHO 

Sent: Thursday, April 1, 2021 9:27 AM 

To: [I fo.com> 

Ce: Qureshi, Hoor EOP/WHO <{@ who.eop.gov> 

Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Ack sorry. Adding Hoor — tomorrow probably easier than today at this point (whichis my fault!) 


From: 2 fb.com> 

Sent: Thursday, April 1, 2021 9:18 AM 

To: Flaherty, Rob EOP/VWHO <{Qwho.eop.gov> 

Subject: [EXTERNAL] Re: Follow up from Friday meeting--additional context re: WhatsApp 


Just checking back here—we can also shoot for early next week if that’s easier at this point? 
Get Outlook for iOS 

From: SS fb.com> 

Sent: Wednesday, March 31, 2021 11:58 AM 

To: Flaherty, Rob EOP/WHO 

Subject: Re: Follow up from Friday meeting--additional context re: WhatsApp 


More shortly on other WA questions—but wanted to provide times — can we shoot for a window late afternoon (4 
or after) on either Thursday or Friday? 


Get Outlook for iOS 


From: Flaherty, Rob EOP/WHO < who.eop.gov> 

Sent: Tuesday, March 30, 2021 7:35:08 PM 

To: © fo.com> 

Subject: RE: Follow up from Friday meeting--additional context re: WhatsApp 


Responses in line! 


From:  fb.com> 

Sent: Sunday, March 28, 2021 8:51 PM 

To: Flaherty, Rob EOP/WHO <i @who.eop.gov> 

Subject: [EXTERNAL] Follow up from Friday meeting--additional context re: WhatsApp 


Rob, 


Thanks again for meeting with us Friday. As discussed, we would love to set up some time with our research 
director who could jon in our next meeting to brief you on our CMU Covid-19 Survey that 
we shared a few weeks ago. Let us know if you’ re interested in covering that this week. 
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All for it. Thursday better than Friday for me. Send some times over and we can coordinate. 


We also wanted to follow up on your questions about WhatsApp. I’m sure you're already attuned to this, but 
think it’s worth noting some of the key differences between a private messaging app like WhatsApp, and social 
media like Facebook and Instagram. Approximately 90 percent of the messages sent on WhatsApp are 
one-to-one, and the majority of group chats include fewer than ten people. WhatsApp does not promote content, 
and users do not build audiences or discover new people as they would on social media. 


Very aware © 


You’ re right that without being able to see the content of messages on WhatsApp, we’re not able to measure 
prevalence (and, relatedly, reduction) of particular types of content. WhatsApp seeks to control the spread of 
misinformation and inform users through deliberate, content-agnostic product interventions -- things like labeling 
and limiting message forwards. The underlying idea there is that messages that did not originate from a close 
contact are less personal compared to typical messages sent on WhatsApp, and may be more prone to contain 
misinformation, The labels (“forwarded”; and “forwarded many times” if the message has been forwarded five 
times or more) are intended to prompt people to stop and think when they are reading a message and before they 
forward something, which may not be accurate. The forward limits (no more than five chats at time; one chat a 
time for highly forwarded messages), are intended to reduce their spread. As mentioned in my earlier note, when 
WhatsApp rolled out the limitation for highly forwarded messages to one chat at a time in Apri] 2020, this 
resulted in a 70% reduction of those messages globally. Of course, not all forwards are misinformation, so these 
are by nature somewhat blunt tools, but they are important ones -- and ones that many other messaging services 
don’t provide. 


A few additional things to note: 


1. WhatsApp also employs best-in-class spam detection technology to spot accounts engaging in mass 
messaging behavior, so they can’t be used to spread spam or viral misinformation. We ban over 2 
million accounts per month for bulk messaging behavior, 75% of them without a recent user report, which 
means our automated systems stop abuse before users can report them. (This white paper describes these 
systems in further detail.) 


We have a thing where we can’t click links from emails — can you send me the white paper? 


2. Another aspect of what WhatsApp does -- again without accessing the content of messages -- is to provide 
tools to empower users to seek out reliable sources of information. One way we've done this in the 
product is through a “search the web” feature we rolled out last August, which allows users to easily double 
check highly forwarded messages they receive on WhatsApp by tapping a magnifying glass button in the 
chat to initiate a web search on their device browser. This helps users find news results or other sources of 
authoritative information about messages they have received from outside their close contacts -- and is 
available in English, Spanish, and other languages. 


Can you show me what this might look like? What kind of testing have you seen around effectiveness? Are 
there other tactics you’ve deployed? Does exposure to forw arded messages change in any way the kinds 
of positive information they’re exposed to on Facebook or Instagram? 


3. WhatsApp also has partnerships with fact checking organizations, government agencies, and international 
organizations, like the WHO, around the world to make authoritative information about COVID-19 and 
vaccines available via WhatsApp. VWhatsApp donated $1M to the International Fact Checking Network 
(IFCN) to support the CoronaVirusFacts Alliance, which brought together more than 100 fact checkers in 
70+ countries in 40+ languages. These organizations have produced 9,000+ unique fact checks, all of which 
are accessible through a global fact-checking bot jointly created by the IFCN and WhatsApp. 
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How do they make the information available? 


4. We're very cognizant of WhatsApp’s use among immigrant communities in the U.S. and we’re focused on 
ensuring these sorts of resources noted above are available in Spanish as well as English. During the 
2020 election we partnered with Univision and Telemundo to make IFCN’s election-related fact checks 
available in Spanish. Both Univision and Telemundo are now in the process of getting approved as certified 
IFCN fact checkers, which will enable them to set up their own Spanish-language fact checks directly on 
WhatsApp with financial support from Facebook. This will add to existing Spanish-language resources 
available via WhatsApp, including the search the web feature and the CoronaVirusFacts Alliance bot 
mentioned above. 


Is this true in other languages? I’m thinking specifically about languages that have prevalence in south 
Asian countries. And in the electoral context, what did you do there that worked and you’re taking into this 
body of work? 


One other initiative we are focused on are partnerships with governments, private healthcare providers, and 
pharmacies to support COVID-19 vaccination efforts through chat tools on WhatsApp. We’ve launched these 
successfully so far in Indonesia, Brazil, South Africa, and Argentina, among other countries, and are very 
interested in exploring ways to replicate some of these efforts in the U.S., especially in boosting the vaccination 
effort within the Latinx community. We are in discussions with the CDC and with officials in California, 
Delaware, and Los Angeles, and we are keen to work together to expand the scope and reach of these 
partnerships. 


| guess | have the same question here as | do on Facebook on Instagram. Do you guys think you have this 
under control? You’re obviously going to say yes to that, so | guess the real question is, as ever: how are 
you measuring success? Reduction in forwarding? Measured impact across Facebook properties? 


Happy to schedule time to discuss any of this further. 
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Exhibit 24 


Email correspondence between 
Facebook and the White House 
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From: GR </O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO; Rowe, Courtney M. EOP/WHO 
Sent: 4/14/2021 11:14:25 AM 
Subject: Re: [EXTERNAL] Re: Connecting 


Hey—I'm really sorry, I missed this ahead of the 11:00. We will definitely prioritize for future. And working on 
both immediate follow ups—running down question on Tucker and working on getting you report by end of 
week. 


From: Flaherty, Rob EOP/WHO <Robert.Flaherty@who.eop. gov> 
Sent: Wednesday, April 14, 2021 10:50 AM 

To: J Rowe, Courtney M. EOP/WHO 

Subject: RE: [EXTERNAL] Re: Connecting 


— Given the briefing at 11 and Andy’s interest in joining, | am wondering if it might be good to consider 
pushing back. If we were to do that, would anything between noon and 1:30 work? If not, we can proceed and folks 
can join as they get free. 


From: (i EO fb.com> 

Sent: Wednesday, April 14, 2021 10:15 AM 

To: Rowe, Courtney M. EOP/WHO <i @ who.eop.gov>; Flaherty, Rob EOP/WHO 
who.eop.gov> 

Subject: Re: [EXTERNAL] Re: Connecting 


Great thanks—Courtney we will follow up on anything that comes out of the 11:00. 


From: Rowe, Courtney M. EOP/WHO 211. 0.200.gov> 


Date: Wednesday, April 14, 2021 at 10:12 AM 


To: Flaherty, Rob EOP/WHO < (i Qwho.cop.gov>, i <I @‘b.com> 


Subject: RE: [EXTERNAL] Re: Connecting 
We have our press briefing this morning at 11 so | won't be there. 


Thanks for sending the stuff below. | just pinged CDC on the FAQ and we will share as soon as they have 


From: Flaherty, Rob EOP/WHO 
Sent: Wednesday, April 14, 2021 10:07 AM 


To: i GE © fb.com>; Rowe, Courtney M. EOP/WHO <{who.cop.gov> 
Subject: RE: [EXTERNAL] Re: Connecting 


| will be there, yes. 


From: i! <SBOfb.com> 


Sent: Wednesday, April 14, 2021 10:04 AM 

To: Flaherty, Rob EOP/WHO <{ @who.eop.gov>; Rowe, Courtney M. EOP/WHO 
0.e0p.gov> 

Subject: Re: [EXTERNAL] Re: Connecting 
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Just confirming with you both that 11:00 this morning still works? You should have calendar invites—Courtney | 
saw you were not on our invite but added you. 


From: i’ EE Of com> 


Date: Tuesday, April 13, 2021 at 11:29 PM 

To: Flaherty, Rob EOP/WHO <I Qwho.eop.gov>, Rowe, Courtney M. EOP/WHO 
who.eop.gov> 

Subject: Re: [EXTERNAL] Re: Connecting 


Hi Rob, Courtney, 


Thanks for this quick response - it was super helpful in informing our overall strategy today. | have some responses 
in blue below. I’m looking forward to the meeting tomorrow and hoping we can spend some time responding to 
Rob’s feedback from last week as well as further discussing the J&J news and how we can hopefully partner 
together. 


Courtney - as we discussed, we also wanted to send over some examples of content we see on our platform that 
we remove (misinformation & harm) as well as content we take other actions on, but do not remove (vaccine 
hesitancy), | have included some examples at the bottom of this email and happy to set up time to talk through this 
more with you as well, if helpful. 


Talk soon, 


Some kind of thing that puts the news in context if folks have seen it (like your current “COVID news” panel) that 
has 3-4 pieces of info (eg: Adverse events are very rare — 6 cases out of nearly 7 million, the FDA and CDC are 
reviewing so it health care providers know how to treat any of the rare events, this does not affect pfizer or 
moderna, which vaccinate via a different mechanism). Happy to provide what those things should be. If the 
ultimate product pulls in social from others, were happy to put something together there as well. 


Thanks very much for the suggestion -- we are consistently updating the news module to provide timely and 
relevant context to users, such as article(s) that provide context on the rarity of experiencing blood clots. We would 
love any suggestions you all would have on trends youre seeing. 


e CDC is working through an FAQ that we'd love to have amplified in whatever way possible — maybe through 
the COVID info panel. 


Thanks—we'll be on the lookout for the FAQ and can discuss tomorrow. 


e A commitment from you guys to make sure that a favorable review reaches as many people as the pause, 
either through hard product interventions or algorithmic amplification 


Would love to talk through this one a bit more. Our goal is to ensure that people have access to authoritative info 
about the vaccine. We're looking forward to talking more tomorrow about our approach to sharing authoritative 
info and wnat we've done today in support of that goal given the J&J announcement. 


More broadly: we share Nick's concern about knock-on effects and are curious to get a read from your CMU data 

about what you're seeing and with whom. Moreover, | want to make sure you have eyes on what might be spinning 
off the back end of this — that the news about J&J doesn't spin off misinformation. Would be great to get a 24 hour 
report-back on what behavior you're seeing. 


We will look to get you insights as soon as we have them. We are going to be watching to see how this plays out 
over the next couple of days. ee is joining tomorrow and plans to share a couple things we are seeing emerge 
from the CMU survey and what we are going to be watching over the next few days. Also, we are proactively 
monitoring and seeing what themes emerge from content on-platform and happy to share out when we have stuff 
collected. 
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VACCINE HESITANCY EXAMPLES: 


The following examples of content are those that do not violate our Misinformation and Harm policy, but may 
contribute to vaccine hesitancy or present a berrier to vaccination. This includes, for example, content that contains 
sensational or alarmist vaccine misrepresentation, disparaging others based on the choice to or to not vaccinate, 
true but shocking claims or personal anecdotes, or discussing the choice to vaccinate in terms of personal and civil 
liberties or concerns related to mistrust in institutions or individuals. We utilize a spectrum of levers for this kind of 
content that is both proportionate and also helps our users make informed decisions. Actions may include reducing 
the posts’ distribution, not suggesting the posts to users, limiting their discoverability in Search, and applying 
Inform Labels and/or reshare friction to the posts. Depending on the category of content, we scale our 
interventions to have the highest public health impact, while understanding that healthy debate and expression is 
important. 
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From: Flaherty, Rob EOP/WHO 
Date: Tuesday, April 13, 2021 at 1:33 PM 
To: @fb.com>, Rowe, Courtney M. EOP/WHO 
who.eop.gov> 

Subject: RE: [EXTERNAL] Re: Connecting 


Hi 


Thanks for reaching out. Andy might reply to Nick separately, but here’s some thoughts . 


who. eop. gov> 


I’m putting our public messaging below, which will be updated and we'll be sure to send to you. 


But generally, | think some combo of the following would be helpful: 


e Some kind of thing that puts the news incontext if folks have seen it (like your current “COVID news” panel) 
that has 3-4 pieces of info (eg: Adverse events are very rare — 6 cases out of nearly 7 million, the FDA and 
CDC are reviewing so it health care providers know how to treat any of the rare events, this does not affect 
pfzier or moderna, which vaccinate via a different mechanism). Happy to provide what those things should 
be. If the ultimate product pulls in social from others, we’re happy to put something together there as well. 

© CDC is working through an FAQ that we’d love to have amplified in whatever way possible — maybe through 
the COVID info panel. 

e A commitment from you guys to make sure that a favorable review reaches as many people as the pause, 
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either through hard product interventions or algorithmic amplification 


More broadly: we share Nick's concern about knock-on effects and are curious to get a read from your CMU data 

about what you're seeing and with whom. Moreover, | want to make sure you have eyes on what might be spinning 
off the back end of this — that the news about J&J doesn't spin off misinformation. Would be great to get a 24 hour 
report-back on what behavior you're seeing. 


Message below, and thanks 


-Rob 


As of April 12, nearly 7 million J&J doses have been administered. CDC and FDA are investigating 6 cases of 
an extremely rare type of blood clot in individuals after receiving the J&J vaccine. As CDC and FDA noted in 
their statemem, right now these adverse events appear to be extremely rare. Out of an abundance of caution as 
they review these rare cases, CDC and FDA are recommending vaccine providers pause on administering the 
J&J vaccine. As FDA noted this morning, they hope to review this quickly over the next few days. This pause is 
important so health care providers know how to treat anv individuals who may experience these rare events. 


This announcement will not have a significant impact on our vaccination plan: J&J vaccine makes up less than 
5 percent of the recorded shots in arms in the United States to date. Based on actions taken by the President 
earlier this year, the U.S. has secured enough Pfizer and Moderna doses for 300 million Americans. You can 
read the full statement from White House COVID-19 Response Coordinator Jeff Zients on the impact on supply 
here. 


We will be back in touch soon to share additional resources and messaging on this issue, as well as our broader 
efforts to advance vaccine confidence and protect America 8 health. 


From: i SO fb.com> 

Sent: Tuesday, April 13, 2021 12:21 PM 

To: Rowe, Courtney M. EOP/WHO {FREE © '0.cop.gov>; Flaherty, Rob EOP/WHO 
who.eop.gov> 

Subject: FW: [EXTERNAL] Re: Connecting 


Courtney and Rob—making sure you also receive this message—we want to get ahead of this but also want to 
make sure we are amplifying the right messages. Let us know if helpful to connect quickly today? 


From: Nick Clegg <j @fb.com> 
Date: Tuesday, April 13, 2021 at 12:18 PM 


To: Slavitt, Andrew M. EOP/WHO <M Qwho. eop.gov> 


Cc: IE BEE Ot com> 
Subject: Re: [EXTERNAL] Re: Connecting 


Hi Andy 
Hope this finds you well? 
Re the J+J news, we're keen to amplify any messaging you want us to project about what this means for people - it 


obviously has the risk of exacerbating vaccine hesitancy, so we're keen to get ahead of the knock-on effect. Don't 
hesitate to tell me - or via your teams - how we can help to provide clarity/reassurance via Facebook. 
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All v best 


Nick 


279 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0009503 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Exhibit 25 


Email correspondence between 
Facebook and the White House 
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From: BR </0=THEFAcEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251COS20BB487E81 11461E3692A624> 


To: Flaherty, Rob EOP/WHO 

Cc: Slauitt, Andrew M. EOP;/WHO 
Sent: 4/14/2021 10:23:05 AM 
Subject: Re: tucker 


Thanks—I saw the same thing when we hung up. Running this down now. 


Get Outlook for 1OS 


From: Flaherty, Rob EOP/WHO <|J@who.eoo.gov> 


Sent: Wednesday, April 14, 2021 1:10:41 PM 
0: I com> 
Ce: Slavitt, Andrew M. EOP/WHO <I @ who. eop.gov> 


Subject: tucker 


Since we’ve been on the phone — the top post about vaccines today Is tucker Carlson saying they don’t work. 
Yesterday was Tomi Lehren saying she won't take one. This is exactly why | want to know what “Reduction” actually 
looks like — if “reduction” means “pumping our most vaccine hesitant audience with tucker Carlson saying it doesn't 
work” then... I’m not sure it’s reduction! 


Rob Flaherty 
Director of Digital Strategy 
The Vvhite House 


| 
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Exhibit 26 


Email correspondence between 
Facebook and the White House 
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From: HE </0)= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: 
Sent: 4/14/2021 8:11:27 PM 
Subject: FW: Tucker Carlson anti-vax message. 


Making sure you receive-- 


From: Nick Clegg BO fb .com> 

Date: Wednesday, Aoril 14, 2021 at 10:51 PM 

To: Slavitt, Andrew M. EOP/WHO <i owhio. cop. gov> 
Cc: ER tb.com> 

Subject: Re: Tucker Carlson anti-vax message. 


Hi Andy - have looked into this some more. 


| realize it may be of limited comfort at this moment, but this was not the most popular post about vaccines on 
Facebook today. Our data is slightly lagging, and we'll get back to you with more detail on this specific post 
tomorrow. Right now, it appears that it probably was among the top 100 most-viewed vaccine posts. I’m including 
a few examples of posts that were more popular today at the end of this note:- 


Regardless of popularity, the Tucker Carlson video does not qualify for removal urder our policies. Following the 
government's decision yesterday, we are allowing claims that the Johnson and Johnson vaccine causes blood 
clots, but we still do not allow categorical claims that it or other vaccines are unsafe or ineffective. 


That said, the video is being labeled with a pointer to authoritative COVID information, it's not being recommended 
to people, and it is being demoted. 


The team is working on the follow ups from the meéting this morning, including more details on most 
viewed/ranked content on Facebook and will be in touch shortly on that - I'm v keen that we follow up as we'd 
agreed, and | can assure you the teams here are oniit. 


Given the timeline that was provided today for further decision about the J&J vaccine, it would be great to get your 
guidance about what affirmative messages we should amplify right now. Consistent with the message we heard at 
the press conferences, we're currently emphasizing the safety and efficacy of the Moderna and Pfizer vaccines in 
the Covid Information Center. 


Popular Vaccine-Related Content on Facebook Today: 


CNN: https:/Avwaw.cnn.com/2021/04/13/health/blood-clots-johnson--iohnson-vaccine-wellness/index html 

ABC: https:/Avwww.facebook.com/10160902498218812 

NBC: https:/Awww.nbcnews.com/health/health-news/what-do-if-you-got-johnson-johnson-vaccine-n1263927 
NY Times: https://Awaw.nytimes.com/2021/04/13/us/politics/johnsonjohnson-vaccine-blood-clots-fda-cdc. htm! 
CDC: https: /Amww facebook.com/10159031890151026 

CBS: https:/Awww.facebook.com/10159467409732010 

Heather Cox Richardson: https:/Avww.facebook.com/297363371758902 


All v best 
Nick 
On 4/14/21, 10:52 AM, "Nick Clegg" @fb.com> wrote: 
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Ok - sorry to hear about call today, will dig in now. N 

On 4/14/21, 10:01 AM, "Slavitt, Andrew M. EOP/WHO" 2 "0.200. gov> wrote: 
Number one on Facebook. Sigh. 
Big reveal call with FB and WH today. No progress since we spoke. Sigh. 


Sent from my iPhone 


284 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0011716 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Exhibit 27 


Email correspondence between 
Facebook and the White House 


285 


From: GR «0-H ACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO 

Cc: Slavitt, Andrew M. EOP;/WHO 

Sent: 4/16/2021 1:45:51 PM 

Subject: Re: [EXTERNAL] FW: Tucker Carlson anti-vax message. 


Hey Rob—understood and sorry for the delay. The team has been heads-down since our conversation to produce 
the report we discussed on Wednesday afternoon. We are aiming to get you something tonight ahead of the 
weekend. We want to respond to your questions below as well but | have been hoping to get this work completed 
and then to schedule a call to discuss. Would that work? 


From: Flaherty, Rob EOP/WHO <Robert.F laherty@who.eop.gov> 
Date: Friday, April 16, 2021 at 4:37 PM 

To: fb.com> 

Ce: Slavitt, Andrew M. EOPAWHO <Andrew.M.Slavitt@who.eop.gov> 
Subject: RE: [EXTERNAL] FW: Tucker Carlson anti-vax message. 


These questions weren't rhetorical 


From: Flaherty, Rob EOPAVHO 


Sent: Wednesday, April 14, 2021 11:35 PM 

[oI ¢2.com> ao 
Ce: Slavitt, Andrew M. EOP/WHO <(M@ who.eop.gov> 
Subject: Re: [EXTERNAL] FW: Tucker Carison anti-vax message. 


And sorry — if this was not one of the most popular posts about the vaccine on Facebook today, then what good 
is crowdtangle? wae 


HE sic that Tomis video was the most popular yesterday based on your data, which reflected what CT was 
showing. Tuckers video was top on CT today. What is different about this video, then? 


Sent from my iPhone 


On Apr 14, 2021, at 11:29 PM, Flaherty, Rob EOP/WHO <fB@who.cop.gov> wrote: 


| guess this is a good example of your rules in practice then — and a chance to dive in on questions as they're 
apolied. 


How was this not violative? The second half of the segment is raising conspiracy theories about the government 
hiding that all vaccines aren't effective. It's not about just J&J. What exactly is the rule for removal vs demoting? 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. YWho is 
seeing it now? How many? How effective is that? 


And we've gone a million rounds on this in other contexts so pardon what may seem like deja vu— but on what 
pasis is “visit the covid-19 information center for vaccine resources” the best thing to tag to a video that says the 
vaccine doesn’t work? 
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Not for nothing but last time we did this dance, it ended in an insurrection. 


Sent from my iPhone 


On Aor 14, 2021, at 11:11 PM, IIB t. com> wrote: 
Making sure you receive-- 


From: Nick Clegg <i@fb.com> 


Date: Wednesday, Aoril 14, 2021 at 10:51 PM 


To: Slavitt, Andrew M. EOP/WHO <0. cop.cov> 


Cc: EG tb com> 
Subject: Re: Tucker Carlson anti-vax message. 


Hi Andy - have looked into this some more. 


| realize it may be of limited comfort at this moment, but this was not the most pepular post about vaccines on 
Facebook today. Our data is slightly lagging, and we'll get back to you with more detail on this specific post 
tomorrow. Right now, it appears that it probably was among the top 100 most-viewed vaccine posts. I’m including 
a few examples of posts that were more popular today at the end of this note. 


Regardless of popularity, the Tucker Carlson vdeo does not qualify for removal under our policies. Following the 
government's decision yesterday, we are allowing claims that the Johnson and Johnson vaccine causes blood 
clots, but we still do not allow categorical claims that it or otherwaccines are unsafe or ineffective. 


That said, the video is being labeled with a pointer to authoritative COVID information, it's not being recommended 
to people, and it is being demoted. a 


The team is working on the follow ups from the meating this morning, including more details on most 
viewed/ranked content on Facebook and Brian will be in touch shortly on that - I'm v keen that we follow up as we'd 
agreed, and | can assure you the teams here are onit. 


Given the timeline that was provided today for further decision about the J&J vaccine, it would be great to get your 
guidance about what affirmative. messages we should amplify right now. Consistent with the message we heard at 

the press conferences, we're currently emphasizing the safety and efficacy of the Moderna and Pfizer vaccines in 

the Covid Information Center. 


Popular Vaccine-Related Content on Facebook Today: 


CNN: =https:/Awwy.cnn.com/202 1/04/13/healtr/blood-clots-johnson-johnson-vaccine-wellness/index.html< 

ABC: =https:/Awww.facebook.com/10160902498218812< 

NBC: >https:/Awww.nocnews.com/health/health-news/what-do-if-yougot-johnsonjohnson-vaccine-n1263927< 
NY Times: =httos:/Awww.nytimes.com/202 1/04/13/us/politics/iohnson-johnson-vaccine-blood-clots-fda-cdc.html< 
CDC: =https:/Awww.facebook.com/10159031890151026< 

CBS: >https://www facebook con/10159467409732010< 

Heather Cox Richardson: >https:/Awww.facebook.com/2973633717583902< 


All v best 
Nick 
On 4/14/21, 10:52 AM, "Nick Clegg" < @fb.com> wrote: 
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Ok - sorry to hear about call today, will dig in now. N 

On 4/14/21, 10:01 AM, "Slavitt, Andrew M. EOP/VWHO" <2 wine .cop.gov> wrote: 
Number one on Facebook. Sigh. 
Big reveal call with FB and WH today. No progress since we spoke. Sigh. 


Sent from my iPhone 
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From: HE 0 = FEF ACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO 
Sent: 4/21/2021 2:01:51 PM 
Subject: Re: [EXTERNAL] FW: Tucker Carlson anti-vax message. 


Rob—thanks for catching up earlier and sorry for the delay in getting these back to you. We can schedule time to 
discuss any of this further if helpful. 


How was the Tucker post not violative? 
e while we remove content that explicitly directs people not to get the vaccine, as well as content that contains 
explicit misrepresentations about vaccines, we reviewed this content in detail and it does not violate those 
policies. 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. Who is 
seeing it now? How many? How effective is that? 
e The video received 50% demotion for seven days while in the queue to ne fact checked, and will continue to 
be demoted even though it was not ultimately fact checked. 


Why does CT tell a different story than our internal number? 
¢ Crowdtangle shows engagement not views, and a simple text search for “vaccine” in Crowdtangle doesn't 
have the same recall as our classifiers, ie., doesn’t include all of the posts about vaccines. The data that we 
provided doesn't include the Tucker Carlson video because our data pipelines don't populate that quickly — 
we provided data for the week before. (The delay in data doesn't mean we aren't able to find and remove 
violating content in real time—our systems do this automatically). 


Why label this content with a generic “visit the covid information center” message? 

e Our more granular label about vaccine safety préviously said “COVID-19 vaccines go through many test for 
safety and effectively before they’re approved”. In light of the decision to pause the J&J vaccine, vaccine 
safety discussion evolved past “approvel,”"and'we were concerned that this was a confusing/irrelevant 
message to be applying to content discussion the decision to pause J&J without revoking approval. We 
temporarily reverted to amore generi¢ message and are updating the more specific label for posts about 
vaccine safety to say “COVID-19 vaccires go through many tests for safety and effectiveness and then are 
monitored closely” to try to adapt to the changing factual situation and evolving discussion. This new 
message is being rolled out and should appear instead of the generic label now. 


From: Flaherty, Rob EOP/WHO <i @ who. cop. gov> 


Date: Friday, April 16, 2021 at 4:37 PM 
To: fo.com> 


Ce: Slavitt, Andrew M. EOPAVHO <2 h0.c0p.gov> 


Subject: RE: [EXTERNAL] FW: Tucker Carlson anti-vax message. 


These questions weren't rhetorical 


From: Flaherty, Rob EOP/WHO 

Sent: Wednesday, April 14, 2021 11:35 PM 

To: fb.com> 

Ce: Slavitt, Andrew M. EOP/WHO < who.eop.gov> 
Subject: Re: [EXTERNAL] FW: Tucker Cariscon anti-vax message. 


And sorry — if this was not one of the most popular posts about the vaccine on Facebook today, then what good 
is crowdtangle? 
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| Ee that Tomis video was the most popular yesterday based on your data, which reflected what CT was 
showing. Tuckers video was top on CT today. What is different about this video, then? 


Sent from my iPhone 


On Apr 14, 2021, at 11:29 PM, Flaherty, Rob EOP/WHO <M who.eop.gov> wrote: 


| guess this is a good example of your rules in practice then — and a chance to dive in on questions as they're 
apolied. 


How was this not violative? The second half of the segment is raising conspiracy theories about the government 
hiding that all vaccines aren't effective. It's not about just J&J. What exactly is the rule for removal vs demoting? 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. Who is 
seeing it now? How many? How effective is that? 


And we've gone a million rounds on this in other contexts so pardon what may’ ‘seem like deja vu— but on what 
basis is “visit the covid-19 information center for vaccine resources’ ae best Shing to tag to a video that says the 
vaccine doesn't work? : 


Not for nothing but last time we did this dance, it ended in an a 


Sent from my iPhone 


On Aor 14, 2021, at 11:11 PM, Eo tb com> wrote: 
Making sure you receive-- 


From: Nick Clegg <]@fb. com> 

Date: Wednesday, April 14, 2021 at 10:51 PM 

To: Slavitt, Andrew M_EOP/WHO (oo. c0p.gov> 
Ce: fb.com> 

Subject: Re: Tucker Carlson anti-vax message. 


Hi Andy - have looked into this some more. 


| realize it may be of limited comfort at this moment, but this was not the most popular post about vaccines on 
Facebook today. Our data is slightly lagging, and we'll get back to you with more detail on this specific post 
tomorrow. Right now, it appears that it probably was among the top 100 most-viewed vaccine posts. I’m including 
a few examples of posts that were more popular today at the end of this note. 


Regardless of popularity, the Tucker Carlson video does not qualify for removal under our policies. Following the 
government’s decision yesterday, we are allowing claims that the Johnson and Johnson vaccine causes blood 
clots, but we still do not allow categorical claims that it or other vaccines are unsafe or ineffective. 


That said, the video is being labeled with a pointer to authoritative COVID information, it's not being recommended 
to people, and it is being demoted. 


The team is working on the follow ups from the meeting this morning, including more details on most 
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viewed/ranked content on Facebook and mi be in touch shortly on that - I'm v keen that we follow up as we'd 
agreed, and | can assure you the teams here are onit. 


Given the timeline that was provided today for further decision about the J&J vaccine, it would be great to get your 
guidance about what affirmative messages we should amplify rignt now. Consistent with the message we heard at 

the press conferences, we're currently emphasizing the safety and efficacy of the Moderna and Pfizer vaccines in 

the Covid Information Center. 


Popular Vaccine-Related Content on Facebook Today: 


CNN: >https:/Awww.cnn.com/202 1/04/13/health/blood-clots-iohnson--johnson-vaccine-wellness/index. html< 
ABC: =https:/Awww.facebook.com/10160902498218812< 

NBC: >https:/Awww.nocnews. com/health/health-news/what-do-if-you-got-johnsonjohnson-vaccine-n1263927< 
NY Times: >hittos:/Amww.nytimes .com/262 1/04/14 3/us/politics/fohnson-johnson-vaccine-blood-clots-fda-cdc html< 
CDC: >https:/Amaw.facebook.com/10159031890151026< 


CBS: >https:/Awuw.facebook.com/10159467409732010< 
Heather Cox Richardson: >https://mww.facebook.com/297363371758302< 


All v best 


Nick 


On 4/14/21, 10:52 AM, "Nick Clegg" <[atb.com> wrote: 
Ok - sorry to hear about call today, will dig in now. N A 
On 4/14/21, 10:01 AM, "Slavitt, Andrew M. EOP/WHO" EE 252.200 c0v> wrote: 
Number one on Facebook. Sigh. - 
Big reveal call with FB and WH today. No progress Since we spoke. Sigh. 


Sent from my iPhone 
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@fb.com]; @fb.coml 
@fb.com]: @fb.com]; Ee 


OU= EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN= RECIPIENTS/CN=NCLEGGE6E] 

Sent: Mon 4/19/2021 9:40:45 AM (UTC-07:00) 

Subject: Re: A/C PRIV White House/Covid 


Yep that is of course right: identify the gaps in their views and our policies (incl via feedback from the researchers they’ve been 


listening to); identify whether there really are such significant gaps between our approach and YT’s; see what further steps we can 
take. 


N 


From: @fb.com> 
Date: Sunday, April 18, 2021 at 7:30 PM 

To: @fb.com>, Nick Clegg 
Cc: Joel Kaplan 


, @fb.com> 
@fb.com>, @fb.com>, 


Subject: RE: A/C PRIV White House/Covid 
AC PRIV: 

As frustrating as these fake leaks and innuendo are (and they are!), my thoughts are that we should not let that distract us from 
the real issues here, which are the substance. Clearly we have a policy viewpoint gap with them we need to figure out perspectives 
on — what we believe violates and what they think does... and the belief that YT is doing better than us, which | find so hard to 


believe. Probably best to spend our effort here and not get sucked into this other thread. 


At the end of the day, unless we get to a common ground on what we’re doing on substance, the rest doesn’t really matter. 


From: @fb.com> 
Sent: Sunday, April 18, 2021 7:05 PM 
To: Nick Clegg 
Cc: Joel Kaplan 


@fb.com>; 


Subject: Re: A/C PRIV White House/Covid 


Thanks Nick. This is obviously very suhag to read. Rob made an offhand comment about conversations with “other people 
from Facebook” during a recent conversation, this is clearly what he was referencing. Because of his history in the digital campaign 
world, it’s not surprising that he’d have relationships with some of our employees. It’s disheartening and unfortunately no longer 
surprising to read that our colleagues would portray our conversations this way. | haven’t been part of any conversation that 
includes disparaging remarks made about Andy, or about any strategy to snow the White House — the only disparaging remarks 
I’ve heard people make on our calls have been in reference to the disrespectful tone Rob uses with employees at Facebook. 


All of that said—Andy’s challenge feels very much like a crossroads for us with the White House in these early days. 


Get Outlook for iOS 


From: Nick Clegg fb.com> 
Sent: Sunday, April 18, 2021 9:07:34 PM 


: @fb.com>; @fb.com> 
Cc: Joel Kaplan .com>; @fb.com>; @fb.com>; 


@fb.com>; @fb.com>; @fb.com> 
Subject: A/C PRIV White House/Covid 


Just got off hour long call with Andy Slavitt. There are some pretty serious — and sensitive (see last point) - issues we need to 
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¢ He was appreciative of the data we sent thru on Friday, and confirmed that Rob F had said that they had never received so 
much data from us before. 


BUT: 
e Andy attended a meeting of misinfo researchers (didn’t provide names) organized by Rob F on Friday in which the 
consensus was that FB is a “disinformation factory”, and that YT has made significant advances to remove content leading to 
vaccine hesitancy whilst we have lagged behind. 
¢ Whilst appreciative of our emphasis on authoritative vaccine, the principal focus for Andy S and his team in the coming 
weeks is to reach the “hardest to reach” people who have a propensity to consume vaccine hesitant related content and who 
are not swayed by official/authoritative sources of content. Our systems, he believes — as confirmed by the researchers — 
feed vaccine hesitant related content to pockets of the population and that’s the problem he wants our help to resolve. 
e As an eg, he was outraged — not too strong a word to describe his reaction — that we did not remove this post which was 
third most highly ranked post in the data set we sent to him: 
https://www.facebook.com/td.mccomas/posts/4106421952731017 | countered that removing content like that would 
represent a significant incursion into traditional boundaries of free expression in the US but he replied that the post was 
directly comparing Covid vaccines to asbestos poisoning in a way which demonstrably inhibits confidence in Covid vaccines 
amongst those the Biden Administration is trying to reach. [It would be very helpful if someone could plse check whether this 
content was also available on YT — Andy’s assumption is that YT would never accept something like this] 
¢ V worryingly, towards the end of the conversation, Andy told me in confidence — so please treat it as such — that internal 
FB employees are leaking to his team (1 assume via Rob F) accounts of disobliging remarks made about both Andy and Rob by 
FB decision makers. Further, that those remarks are coupled with suggestions about how FB should “snow” the White House 
with info/data about authoritative Covid info in order not to share the most telling/helpful data about content which 
contributes to vaccine hesitancy. We then discussed the wider issue of trust — or the lack of it — between FB and the Biden 
team related to the events during the election and beyond, but needless to say | was shocked and embarrassed that 
somehow we are perceived to be behaving so unprofessionally. 


We concluded that he would ask Rob F to share the data and policy recommendations from the researchers with us asap so that 
we could give a considered reply on further steps we may/may not be able to take. We agreed to speak again once that assessment 
has been made. 


Given what is at stake here, it would also be a good idea if we could regroup to take stock of where we are in our relations with the 
WH, and our internal methods too. 


Thx 


N 


Date: Saturday, April 17, 2021 at 6:37 PM 


To: Nick Clegg fb.com>, 
Cc: Joel Kaplan @fb.com>, 


@fb.com> 
Subject: Re: Email to Andy with report 


@fb.com> 


Thanks Nick—here are some talking points that you can use if Andy raises Rob’s questions: 


How was this [Tucker Carlson] post not violative? 
¢ while we remove content that explicitly directs people not to get the vaccine, as well as content that contains explicit 
misrepresentations about vaccines, we reviewed this content in detail and it does not violate those policies. 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. Who is seeing it now? How 
many? How effective is that? 
© The video is receiving 50% demotion for seven days as it is in the queue to be fact checked 
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Why does CT tell a different story than our internal number? 
* Crowdtangle shows engagement not views, and a simple text search for “vaccine” in Crowdtangle doesn’t have the same 


recall as our classifiers, i.e., doesn’t include all of the posts about vaccines. The data that we provided doesn’t include the 
Tucker Carlson video because our data pipelines don’t populate that quickly — we provided data for the week before. 


Why label this content with a generic “visit the covid information center” message? 
© Our more granular label about vaccine safety says “COVID-19 vaccines go through many test for safety and effectively 


before they’re approved”. In light of the decision to pause the J&J vaccine, vaccine safety discussion evolved past “approval,” 
and we were concerned that this was a confusing/irrelevant message to be applying to content discussion the decision 

to pause J&J without revoking approval. We temporarily reverted to a more generic message and are updating the more 
specific label for posts about vaccine safety to say “COVID-19 vaccines go through many tests for safety and effectiveness 
and then are monitored closely” to try to adapt to the changing factual situation and evolving discussion. 


From: Nick Clegg fb.com> 
Date: Saturday, April 17, 2021 at 3:30 PM 


To: @fb.com>, @fb.com> 
@fb.com> fb.com>, i fb.com>, 


Cc: Joel Kaplan 
@fb.com> 


Subject: Re: Email to Andy with report 


No time yet - | asked him to ping me when he wants to spk. If you want to jot down a few thoughts we Rob’s Qs that’s great but 


don’t disturb your weekend unduly, I’m sure | can manage without too. 


Get Outlook for iOS 


Sent: Saturday, April 17, 2021 12:05:37 PM 


To: Nick Clegg fb.com>; 
Cc: Joel Kaplan @fb.com>; 


@fb.com> 


Subject: Re: Email to Andy with report 


@fb.com> 


ds for a specific time this weekend? We aren’t responding to Rob’s questions over 


Nick—let us know if your call with Andy 
e Andy brings these up. 


email but we can still get you some in 


From: Nick Clegg fb.com> 
Date: Friday, April 16, 2021 at 9:07 PM 


@fb.com> @fb.com> 
Cc: Joel Kaplan @fb.com> fb.com>, a fb.com>, 


@fb.com> 
Subject: Re: Email to Andy with report 


Done — thx so much. N 


From: EE © fb.com> 

Date: Friday, April 16, 2021 at 5:53 PM 
@fb.com>, Nick Clegg 
@fb.com>, 
@fb.com> 


Subject: Re: Email to Andy with report 


Nick—attachedgriheneperttonsend withctinese mail. 296 
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@fb.com> 


Cc: Joel Kaplan 


META-118HJC-0053334 


Date: Friday, April 16, 2021 at 8:12 PM 


fb.com>, @fb.com> 


@fb.com>, 


@fb.com> 
Subject: Re: Email to Andy with report 


To: Nick Clegg 
Cc: Joel Kaplan 


Suggested update below to reflect that you said this to him in your last note: “I realize it may be of limited comfort at this moment, 
but this [Tucker Carlson post] was not the most popular post about vaccines on Facebook today. Our data is slightly lagging, and 
we'll get back to you with more detail on this specific post tomorrow. Right now, it appears that it probably was among the top 100 
most-viewed vaccine posts. I’m including a few examples of posts that were more popular today at the end of this note.” 


From: Nick Clegg fb.com> 
Date: Friday, April 16, 2021 at 4:42 PM 


To: @fb.com> 


Cc: Joel Kaplan @fb.com> fb.com>, nn fb.com>, it 


fb.com> 


Subject: Re: Email to Andy with report 


And you'll be answering the other points on the other thread with Flaherty? Would be good for me to have those for my call with 
Slavitt 


Get Outlook for iOS 


From: Nick Clegg a fb.com> 
Sent: Friday, April 16, 2021 4:40:40 PM 


Cc: Joel Kaplan @fb.com>; @fb.com>; fb.com>; is 
@fb.com>; @fb.com> 
Subject: Re: Email to Andy with report 


Yep fine - looking forward to getting the attachment | should send. N 


Get Outlook for iOS 


Sent: Friday, April 16, 2021 4:34:31 PM 


To: Nick Clegg fb.com> 
Cc: Joel Kaplan fb.com>; fb.com>; is fb.com>; ie 
EE 2 '0 com>; @fb.com> 


Subject: Email to Andy with report 
Nick— 


We are in final stages of approval for the report that will go to the WH tonight. Think best if you send to Andy with an email 
confirming you can talk this weekend—and | can forward to Rob. 


Draft email below: 
Andy, 


Wanted to make sure to get this to you ahead of the weekend. We believe this is responsive to what you have asked us to do — 
namely to provide information on what we are seeing on the platform with respect to vaccine content, as well as the interventions 
we are deploying to counter misinformation. As | mentioned yesterday, our data is lagging and this covers the period 4/5 to 4/11. | 
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This probably goes without saying, but | want to make sure to convey that this is not information we normally share, and this data 
set is not cleanly vetted according to an integrity process that would take much longer to conduct. We took your cue the other day 
that it was important to get this to you quickly even if not polished. We have not made this information public and we hope to 
continue to be able to share with you and the team under confidence. 


We hope we can continue to engage on the content provided here, and we’re happy to schedule time next week to discuss with 
the team. 


Look forward to talking this weekend. 
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7/23/23, 12:32 PM Timothy McComas - UH OH Illl | Facebook 


a: | ne: = "T 


Forgot account? 


a Toney MSOs English (US) - Espafiol - 
laden Portugués (Brasil) - Francais (France) 
UH OH HII Deutsch 
= = 
10 years from now you will — 
. Meta © 2023 
be watching TV and hear... 
1 . 
'Did you or a loved one 
take the covid vaccine? 
> 1 
2 comments 385K shares 
See more of Timothy McComas on Facebook 
“ 
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From: 


To: 

Cc: 

Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 

Date: Friday, August 6, 2021 7:13:48 PM 

+ for Comms visibility; 
for Legal 

Hi all, 


Thanks so much again for the sprint on this. Leadership met today and decided we should move forward on our 4 
recommendations (pasted below and also in our team’s working doc here <https://docs.google.com/document/d/1x- 


EkjIF-1_eNTXeNx-UwYP8Y15YKUHjzur8BrTqyD9c/edit> ) and scope the exact product work needed to 


implement and then execute on the ones that are relatively easy to do. 


will be driving next steps on this overall while I’m out on PTO next 


week, coordinating with and will reach out to our Product counterparts on Options 2a, 2b, and 2c. 
could you be on point to further scope Option 1a with your Recs Product 


counterparts? 


and , please let us know if there’s 


additional feedback you got on the Product side for how to best scope these options and whom to involve. I 
appreciate you flagging earlier today that we'll have to make some prioritization calls as we scope each of these 


options further. 


‘ and 
@fb.com> , please let us know if you have any immediate thoughts on deadline to turn v2 of these 
options around. We’ll move fast but aren’t aware of a specific moment when we need to commit to any of these 
privately or publicly with external stakeholders. 


Recommendations to further scope: 
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Option la. Designate linked assets as non-recommendable 


* Impact: Any assets linked to Groups/Pages/Profiles/Accounts that have been removed for COVID misinfo 
violations would not be recommended to users. E.g., RFK Jr.’s IG Account is removed, so his FB Page will be non- 
recommendable. 

* Recommendation: We recommend this as a stop-gap measure specifically targeting Disinfo Dozen assets. Per 
the recent Avaaz <https://secure.avaaz.org/campaign/en/fb_algorithm_antivaxx/> report, some entities affiliated 
with removed Disinfo Dozen Pages are still being recommended because they do not have recent violations. 

7 Difficulty: Low (1-6 weeks) 


1. 
Option 2a. Count COVID M&H, Vaccine WDH, & COVID RFH toward misinfo Repeat Offender Status 


. Impact: Currently, strikes for COVID Misinfo & Harm, Vaccine Widely Debunked Hoaxes, and COVID 
Repeatedly Fact-Checked Hoaxes receive Community Standards strikes, but they do not count towards 
Misinformation Repeat Offender (RO) Status. If we count those strikes towards Misinfo RO Status, entities 
spreading COVID or vaccine misinfo would more quickly receive related penalties, such as content demotion or an 
advertising ban, on top of normal CS penalties. 

" Recommendation: We recommend this because the Misinfo RO system is meant to penalize misinfo actors and 
therefore should count this content,which is more egregious than false information fact-checked by a 3PFC. 

* Difficulty: Low (1-6 weeks) 


Option 2b. Develop a strike system for health-related Partly False and Missing Context ratings that could trigger 
domain/Page/Group/account Repeat Offender (RO) status in more instances [Note: leadership feedback is to 
develop this for DOMAINS only] 


* Impact: Our latest analysis of URLs directing to Disinfo Dozen webpages found that a significant percentage 
of the most viewed URLs have Partly False or Missing Context 3PFC ratings. Counting health-related Partly False 
and Missing Context ratings toward entity-level penalties could allow us to take stronger action to reduce the 
distribution of the domains and associated entities themselves. 

= Recommendation: We recommend this as it is consistent with the precedent of taking stronger measures 
against Covid-related fact-checked content. However, this requires considerable lift for just a small set of bad 
actors. 

* Difficulty: High (6+ ») 

= In the interim, we co te in-Feed domains associated with removed entities (note: three Disinfo Dozen 
domains are already experienéing demotion under Misinfo RO penalties). 


Option 2c. Demote Partly False rated Covid or vaccine misinformation more strongly 


* — Demote Partly False rated Covid or vaccine misinformation more strongly (up to 80% from 50% today) 
(Recommended) 

* Impact: COVID or vaccine misinfo that we don’t remove would appear lower in people’s News Feed. 

* Recommendation: We are already demoting COVID content rated Missing Context as a BTG and see this as 
consistent with that precedent. 

* Difficulty: Low (1-6 weeks) 
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From: @fb.com> 
Date: Tuesday, August 3, 2021 at 7:46 PM 
@fb.com>, @fb.com>. 


com>, 


@fb.com>. 
(@fb.com>, 


@ 


@fb.com>. 
@fb.com> 
@fb.com> 


Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 


Date: Tuesday. August 3, 2021 at 11:11 AM 


(@fb.com>. 


@fb.com>. 


@fb.com>. 
@fb.com> 


. ay =~ 
@tb.com>. a om>, 
@fb.com>, @fb.com>. 


@fb.com> 
Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 


Thank you SO much to everyone who’s already chimed in on the doc. We just learned the leadership meeting has 
been postponed until Friday, so we have another 24 hours to get any additional Product input. ee will also 
side-ping a couple of you today to resolve open comments from overnight. 


@fb.conff 


Date: Tuesday, August t 11:01 AM 


(@tb.com>, 
@fb.com>. 


@fb.com>, 

@fb.com>, 
@fb.com> 

Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 


i= 
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Date: Tuesday, August 3, 2021 at 11:39 AM 


@fb.com>. 


@fb.com>, @fb.com>. ey 
fb.com> 


(@tb.com>. 
(@tb.com>, 


Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 


———EEEEEEaaee 


Date: Tuesday, August 3, 2021 at 6:00 AM 


@fb.com> 
Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 


—————— 


Feedback from Health Integrity London 


1. RFHstrikes for demi not in production. We had strikes for RFH deletes and plan to enable strikes for 

demotions as a P2 for Q3 whéa we onboard responses to Misinformation’s infra. RFH has ~40 new content 

enforcements per day (excluding banking which is ~550/day). 

2. RE Section 3 “Demote more content” - As we plan to integrate with misinfo’s infra for all responses (P1 Q3) 

these features could be prioritised for launch at that time. ee ee fb.com> to 

comment on feasibility/timelines. 

3. Ihave added another section with additional BTGs measures for consideration. One of which is automated 

Feed demotions on Covid posts by Health Misinfo Ros which was a BTG lever that we launched during the 

lockdown with Feed Integrity. At that time it was developed with Anita Joseph, but while she’s out I believe 
(@fb.com> is covering here. 


Thanks 


Date: Tuesday, 3 August 2021 at 01:43 
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Subject: Re: Urgent help assessing misinfo/misinfo adjacent Policy options 


Links Integrity will own section "2. Off platform links enforcement" for your requested ETA of Tues 8/3 @ Ipm. 


Happy to provide input elsewhere in the doc where offsite content is discussed (will read through, and please tag me 
if I miss anything). 


From: @fb.com> 
Sent: Monday, August 2, 2021 5:39 PM 


Subject: Urgent help assessing misinfo/misinfo adjacent Policy options 


Hi PMs in the To line, 


With apologies in advance for the short notice, could we please ask for a quick gut check by | pm PT tomorrow 
(Tuesday) on the implementation feasibility of this list <https://docs.google.com/document/d/1x-EkjIF- 
1_eNTXeNx-UwYP8Y15YKUHijzur8BrTqyD9c/edit> of policy options to be more aggressive against Covid and 
vaccine misinformation, to inform a leadership conversation happening Wednesday? 


Context: Leadership asked Misinfo Policy and a couple of teams on Product Policy to brainstorm some additional 
policy levers we can pull to be more aggressive against Covid and vaccine misinformation. This is stemming from 
the continued criticism of our approach from the US administration and a desire to kick the tires further internally on 
creative options. (We know there’s also a parallel effort to brainstorm Product/BTG levers we can pull.) 


We’ve been sprinting over the past several days and have both dusted off some ideas we’d previously discussed with 
our Product counterparts (ie you), and come up with some net new ideas. 
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We need to send these to leadership by EOD Tuesday, in advance of a Wednesday meeting with iii 
, and others, where they’II discuss. 


Questions for you are: 


1. Are any of these ideas definitely not feasible from a Product POV? 
2. For all the ideas that are feasible, could you indicate in our doc whether they are a light (1-6 weeks to 
implement) or heavy lift (> 6 weeks)? 


Thanks so much, 
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To be combined with SR’s master note to Nick C. 


|S want to be clear in introducing these policy options -- either in intro to your 
note or when we get to these recs -- 


1) that we’ve ordered these from most to least impact reducing the spread of Covid and 
vaccine misinformation. More impactful options carry more risk of overenforcement. 
We have also included at the bottom a list of work in progress this half that we believe 
will be impactful and could consider previewing to external audiences. 

2) We have given our Product counterparts a heads up that we’re being asked to 
consider additional options, but they have not had time to fully vet most of these 
ideas. The recommendations below are principled from a Policy perspective, but we’d 
want to run all of these options by Product/XFN teams to better understand feasibility 
before moving forward. 

3) We have also not had Data Science analyze these options, so we can’t fully understand 
their ultimate on-platform impact. 

4) Our recommendations are specifically targeted at addressing the problem posed by the 
disinformation dozen accounts continuing to have presences on Facebook/Instagram. 
Most of the problematic content critics such as the Center for Countering Digital Hate 
(CCDH) associate with the disinfo dozen are URLs to off-platform content we don’t 
enforce on as a matter of principle. This URL content appears to have a higher prevalence 
of violating/BV content than the on-platform content posted by the disinfo dozen. We 
could change our policy approach and start enforcing off platform, but we don’t support 
that from a principled perspective and this would be resource intensive to implement. 
And blackholing their domains is too blunt, since lots of the content they post on- and off- 
platform is not about Covid or vaccines. Instead, we’re recommending steps to give 
less distribution to.disinfo dozen URLs so they have less reach and visibility. For example, 
our fact-checkers have rated some of the most viral and misleading disinfo dozen URLs, so 
one option below is to leverage that signal to give even less distribution to these domains. 


1. Cross-platform enforcement 


i. Impact: Any assets linked to Groups/Pages/Profiles/Accounts that have 
been removed for COVID misinfo violations would not be recommended 
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to users. Ex: RFK Jr.’s IG Account is removed, so his FB Page will be non- 
recommendable. Currently, such Pages and Accounts can still be 
recommendable. 

ii, Recommendation: We recommend this as a stop-gap measure 
specifically targeting Disinfo Dozen assets, while we contemplate an 
escalation policy (with Rec and Actor/Behavior teams) with clear criteria 
and guardrails for determining “linked assets.” Per recent Avaaz report, 


some entities affiliated with removed Disinfo Dozen Pages are still being 
recommended because they do not have recent violations (e.g. Del 
Bigtree’s FB Page and Informed Consent Action Network Page are 
recommended despite removal of his High Wire with Del Bigtree Page). 
iii. Difficulty to implement: Light (if implemented on escalation) (1-6 weeks) 
Recommended) 


i. Impact: Remove any assets linked to Groups/Pages/Profiles/Accounts 
that have been removed for COVID misinfo violations. Ex: RFK Jr.’s IG 
Account is removed, so we would also remove his FB Page and Profile 
(even though those entities no longer post COVID vaccine misinfo). This 
would impact approximately 50 non-violating entities associated with the 
Disinfo Dozen. 

ii. | Recommendation: We do not recommend this, as it would remove 
entities that have nothing to do with COVID or vaccine content and could 
result in over-enforcement (e.g., if RFK, Jr. was an admin for his child’s 
PTA Group). 

iii. Difficulty to implement: Light (if implemented on escalation) (1-6 weeks) 


2. Off platform li rcement 
a. Blackhole 
Recommended) 


i. Impact: If we blackholed all 28 URL domains associated with the Disinfo 
Dozen, this would remove at least 250M pieces of content, including 
private messages. Furthermore, if we blackholed all URL domains 
associated with any entity we remove for health misinfo violations, the 
amount of content removed would be astronomical. 

ii, Recommendation: We do not recommend, as it risks enforcing on large 
volumes of historical content that may not be violating or unrelated to 
COVID/vaccines. 


' Blackhole (to) = block across all FB surfaces, ie. content will not be displayed (and, by extension, will be 
impossible to click on) 
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iii. Difficulty to implement: Light, if implemented for disinfo dozen 
specifically (1-6 weeks) 

b Revi | bank violating URLs (Not R lod) 

i. Impact: We can remove content linking to specific URLs with prominent 
COVID misinfo violations using a URL text bank, without blocking the 
entire domain or requiring an adversarial signal (as required by current 
policy). 

ii, Recommendation: We do not recommend this approach, as there are 
thousands of URLs we’d need to review and this risks setting a precedent 
that exceeds our enforcement capabilities. 

iii. Difficulty to implement: Eng -- light (1-6 weeks), Ops + Policy -- heavy 

3. Demote more content 


i. Impact: Currently, strikes for COVID Misinfo & Harm, Vaccine Widely 
Debunked Hoaxes (WDH), and COVID Repeatedly Fact-checked Hoaxes 
(RFH) receive Community Standards strikes, but those strikes do not 
count towards Misinformation (i.e., 3PFC) Repeat Offender (RO) Status. 
If we count those strikes towards Misinfo RO Status, entities spreading 
COVID or vaccine misinfo could more quickly be placed in Misinfo Repeat 
Offender status and, as such, have their content demoted and be banned 
from advertising on top of normal CS penalties. 

ii. | Recommendation: We recommend this proposal because our misinfo 
Repeat Offender system is meant to penalize misinfo actors and, 
therefore, it should count this content (which is more egregious than 

information fact-checked by a 3PFC). This change could not happen 
immediately because we would first need to make some Product changes 
(e.g., increase notification transparency and ensure strikes are being 


counted fairly). 
iii. Difficulty to implement: Light (1-6 weeks) 


i. Impact: DS’s latest analysis of URLs directing to Disinfo Dozen webpages 
found that a significant percentage of the most viewed URLs have Partly 
False or Missing Context 3PFC ratings. Therefore, counting these ratings 
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toward entity-level penalties could allow us to take stronger action to 
reduce the distribution of the domains and associated entities 
themselves. While we work out the details, we could, as a stop gap 
measure, demote in-Feed domains associated with removed entities 
(note: three Disinfo Dozen domains are already experiencing demotion 
under Misinfo RO penalties). 

ii, Recommendation: We recommend this as an option tailored to 
addressing concerns about the Disinfo Dozen that is also consistent with 
precedent of taking stronger measures against Covid-related fact- 
checked content. However, we note Product’s concerns that this requires 
considerable lift for just a small set of bad actors. 

iii. Difficulty to implement: Heavy (>6 weeks) 


a_i = avo = ae aVeWaa a 


i. Impact: COVID or vaccine misinfo that we don’t remove would appear 
lower in people’s News Feed. 
ii, Recommendation: We are already demoting COVID content rated 
Missing Context as a BTG and see this as consistent with that precedent. 
iii. Difficulty to implement: Light (1-6 weeks) 
4. Lower strike thresholds for entity disables 


N\mand Dead ad no 1D 5 


i. Impact: We disable entities under our DVDE whether they have 2+ strikes 
and 5 of their last 15 posts are borderline vaccine (BV) discouraging. 
Under this proposal, we would look at prominent off-platform BV when 

ring whether it meets the 5 out of 15 BV criteria, so more entities 
wowld be disabled. 

ii. | Recommendation: We do not recommend this, as we currently have 
poor notice for this policy, especially for the BV portion, and no plans to 
build out additional notice. 

iii. Difficulty to implement: TBD 


i. Impact: We currently only remove Pages/Groups/IG Accounts under 
DVDE, and not Profiles. This recommendation would make FB Profiles 
eligible for removal under DVDE, but at a higher strike total than other 
entities (e.g. 5 health CS strikes + BV, as opposed to 2 CS strikes for 
Groups/Pages/IG Accounts). 
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Work we’re already pl 


ii, ©Recommendation: We do not recommend this because we generally 
tread more carefully around FB Profiles and, when we previously 
investigated this proposal, we found it had a very minimal impact. 


iii. Difficulty to implement: TBD 


i. Impact: This would accelerate how quickly we take down a FB Profile that 
repeatedly spreads harmful COVID or vaccine misinfo, e.g. from 13 CS 
strikes to 6 health CS strikes. 

ii. | Recommendation: While may appear to be a reasonable measure, 
specifically because the FB profile disable threshold to 6 for violations 
such as pharma & non-medical drugs, we do not recommend this option 
sine we tread more carefully around FB profiles and expect the overall 
impact would be minimal. 


iii. Difficulty to implement: TBD 
d. Count COVID M&H and Vaccine WDH as severe strikes (Not Recommended) 


i. Impact: This would accelerate ho ick we apply penalties to and 
disable entities (e.g. Page dsatiOees evere strikes; currently it takes 5 


CS strikes to disable). 
ii. Recommendation: We commend this measure, as we reserve 
severe strikes for the stintegrity violations (e.g. terrorism, CEI, 


human exploitati 
iii. Difficulty to i 


law 


[Borderlinefap| a Accelerate product efforts to demote entities that spread 
eterna ine content (not a Misinfo policy). This would demote entities based on 
the amount of BV content they have. This is already approved and requires product 
support. A policy consideration to accelerate might be lifting the requirement for notice 
and appeals, but this is not recommended given that the classifier is immature and likely 
to have higher false positives. 


2. Adding new false COVID claims we remove for misinfo & harm 
3. Adding new false COVID claims to reduce/inform for RFH 
4. Publish our misinfo repeat offender policies more transparently 
5. Clarify principles for removing additional kinds of non-Covid specific vaccine 
misinformation that could cause hesitancy in Covid vaccine uptake (for example, our 
policies do not yet cover an extensive list of false claims about childhood immunization, 
CONFIDENTIAL TREATMENT REQUESTED 310 META-118HJC-0053348 


NOT FOR DISTRIBUTION 
MEMBERS & STAFF ONLY 


which may contribute to COVID-19 vaccine refusals and will be especially relevant as 
vaccinations are approved for children in the fall and next year). 

6. Implement (with Product) a new enforcement and detection platform that allows us 
to act more quickly on newly emerging false claims related to Covid. The platform will 
make it easier for us to “source” new false claims about Covid and vaccines based on the 
prevalence of the claim on our platform (already testing this now) and allow us to more 
efficiently “match” content to false claims and remove the content. 
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From: Nick Clegg {j@fb.com> 
o—_ Thursday, August 19, 2021 5:25 PM 


Subject: Re: [A/C PRIV] Enforcement Update re COVID-19 
Yep this looks good thx. N 


Get Outlook for iOS 


— 
Sent: Thursday, August 19, 2021 4:24:53 PM 
To: Nick Clegg 


@fb.com> K ; ; a 


Subject: [A/C PRIV] Enforcement Update re COVID-19 


Nick, aT 0 


This email provides a follow-up to our August 6th discussion regarding our respons oee: General on 
COVID-19 misinformation. During that discussion, we agreed to further explor creet policy options for 
reducing the prevalence of COVID-19 misinformation on our platforms. Sim¢ge the jeans have scoped the 

requirements for executing those options. As discussed further below. =a to roll-out the first three options 
over the next coming weeks, and will roll-out the fourth option as an 96 


Please let us know if you have any concerns with the following plarmby 9 am ET tomorrow; otherwise, we 
plan to provide an update to the Surgeon General and wey against these tomorrow. 


Thank you, 
= 


1. Option 1: Designate any assets linked ie s/Pages/Profiles/Accounts, which have been removed 


for COVID misinfo violations, as n mendable to users. 
a. Impact: Any asset linked ages/Profiles/Accounts that have been removed for COVID 
misinfo violations would rt ommended to users (€.g., RFK Jr.'s |G Account is removed, so his 
FB Page will be non-g 
b. Status: By the end 


eek, we will enforce on approximately 60 linked assets related to the 


Disinfo rag gee een removed for COVID misinfo violations. Over the next three weeks, 
we will engage work to understand how to mitigate the risk of over-enforcement here. We 
will then r iro recommendation on a broader policy change that will affect more than just 
the 60 Dis ozerrlinked assets. 


2. Option 2: Count COVID Misinformation & Harm (M&H), Vaccine Widely Debunked Hoaxes (WDH), & 
COVID Repeatedly Fact-Checked Hoaxes (RFH) toward Misinformation Repeat Offender status. 

a. Impact: Currently, only 3PFC-rated False/Altered content counts toward misinfo repeat offender 
status, which results in demotions and demonetization for entities. Counting COVID M&H, Vaccine 
WDH, and COVID RFH strikes towards misinfo repeat offender status would more quickly penalize 
entities spreading COVID or vaccine misinfo on top of our normal Community Standards penalties. 

b. Status: We are targeting the end of September for launch. This includes updating language on 
existing transparency surfaces to notify affected entities how content we remove for COVID/Vaccine 
violations factors into their Repeat Offender status. 
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3. Option 3: Demote COVID or vaccine misinformation rated Partly False more strongly. 

a. Impact: We currently demote content rated Partly False at 50%. We will increase that demotion level 
to 80% for COVID and vaccine misinfo. Note: In the last month, fact-checkers applied “Partly False” 
ratings to at least 1k COVID-19/vaccine content. 

b. Status: We are targeting the end of next week for launch. This includes transparency updates in an 
existing NewsRoom Post (link). 


4. Option 4: Count COVID or vaccine-related URLs that are rated Partly False or Missing Context 
towards “domain” Repeat Offender (RO) status (i.e., penalize the URL domains from which the 
content was shared). 

a. Impact: The Disinfo Dozen report faulted FB for allowing users to share URLs linked to the Disinfo 
Dozen. Misinfo Policy found that, for the most viral Disinfo Dozen URLs rated by third-party fact 
checkers, 85% of those ratings were either Partly False or Missing Context. However, only False 
ratings count towards misinfo repeat offender status, which means, for those URLs rated False, all 
user shares of that URL's domain will be demoted. 

b. Status: 

i. Change: This is a heavy lift to integrate into our existing repeat offender system. Instead, we 
will approach this as an on-escalation break-the-glass measure. We will periodically manually 
review domains that had a high number of third-party fact check ratings to see if enough of them 
were COVID or vaccine related. We will enforce on domains that meet that threshold manually 
for 90-day domain demotion (note: threshold is still TBD). Misinfo Policy and Product are 
aligned on this modification of the option as a BTG solution. 


ii. Caveats: This will not flow through the normal repeat offender proc ill not have 
messaging that domain repeat offender status has been met. eyem many of our domain 
repeat offender demotions do not give notification unless t is explicitly tied to a page. 
We will need to have a reactive comms plan for partners that experience these demotions. 


o. 
Ror 
S 
© 
on 
Q 
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From: Nick Clegg </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=NCLEG GE6E> 


To: Slavitt, Andrew M. EOP/WHO 

cc: 

Sent: 4/23/2021 3:50:03 PM 

Subject: Re: [EXTERNAL] Re: Can we speak this weekend? 
Andy 


Just closing the loop on the specific question you asked below: I asked our data team to 
dig in to determine whether the post received any type of artificial boost (le sponsorship) 
and they confirmed it had none, ie the distribution was “authentic" (ie it was simply 
shared a lot) most Likely because of it's satirical if provocative content. 


But that of course does not address your wider questions about whether we're drawing the 
lines re what is removed and/or demoted in the right place. Our teams consult pretty 
extensively with public health and misinfo experts who have varied opinions on the merits 
of wider removal, but we're looking at options currently and I — Ce hopeful of 
receiving any data Rob can share from the researchers you met too. I'll reach out again 
as/when we have worked up new proposals. 


Best 
Nick 


On 4/21/21, 7:13 PM, "Slavitt, Andrew M. EOP/WHO" 5 =i (awtstsisiéi wrote: 


My team is handling the sequencing funding in the WH. Tell me more of what the interest is 
and I can figure it out. 


Look forward to hear how you resolve the item you reviewed. For it to be third most 
popular, T assume it’s getting promoted. 


Sent from my iPhone 


> On Apr 21, 2021, at 9:45 EM, Nick Clegg (EE: «com> wrote: 

> 

> Andy 

> Good to speak to you on Sunday = I understand and Rob had a productive follow up 
call today, and I'll get back to you with some further responses asap (I did check whether 
the post we discussed - Leonardo di Caprio pic etc —- was running on other platforms, which 
it is, but agree there are wider issues). 

> 

> In meantime, Mark Z and Priscilla Chan were asking who they could be in contact with at 
the WH about this?: 
> 


> https://urldefense.com/v3/__https://www.whitehouse. gov/briefing-room/statements—releases 
/2021/04/16/ fact-sheet-biden-administration-announces-1-7-billion-investment-to-fight- 
covid-19-variants/  ;!!Bt8RZUm9aw!ucsp50mO07qi8uzj4 3yGeGyOd-8CZKCbWT £4e00aQVJ3Fe- 
xr9rQsB7rKSBIS 

> Joe DeRisi/Biohub/CZI have done some open source work on this so they would loye to get a 
sense of the plan(s) and see if they can share any of CZI's learnings? 


> Many thx 


> N 


> On 4/16/21, 7:51 PM, “Slavitt, Andrew M. EOP/WHO" 50 (awttiti‘i‘éa wrote; 


> IT will give you a ring in the morning your time. Thanks Nick. 
> Sent from my iPhone 
315 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0009731 


NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


>> On Apr 16, 2021, at 9:07 PM, Nick Clegg <H: «>. con wrote: 

>> 

>> Andy, 

>> 

>> Wanted to make sure to get this to you ahead of the weekend. We believe this is 
responsive to what you asked for - namely to provide information on what we are seeing on 
the platform with respect to vaccine content, as well as the interventions we are deploying 
to counter misinformation. As I mentioned yesterday, sur data is lagging and this covers 
the period 4/5 to 4/11. T don’t yet have a more specific answer on the Tucker Carlson post. 
>> 

>> This probably goes without saying, but I want to underline that this is not information 
we normally share, and this data set is not cleanly vetted according to an integrity 
process that would normally take much longer. But we took your cue the other day that it 
was important to get this to you quickly even if not polished. We have not made this 
information public and we hope to continue to be able to share with you and the team under 
eonfidence. 

>> 

>> Look forward to talking this weekend - just tell me when suits best. 

>> 

>> Nick 

>> 

>> On 4/16/21, 3:17 AM, "Slavitt, Andrew M. EOP/WHO" . fees wrote: 
>> 

>> 

>> Sent from my iPhone 

>> 

>> <4-16 — COVID-19 Insights.pdf> 


> 
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Exhibit 31 
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/O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=PETERSIMONESF28> 


From: 


To: 

cc: 

Sent: 4/29/2021 10:51:17 AM 
Subject: Re: Vaccine Policy 


From: Nick Clegg <iJ@fb.com> 


Date: Wednesday, April 28, 2021 at 9:33 PM 


Subject: Re: Vaccine Policy 


Thanks — and would we accompany this with a team recommendation for Mark and Sheryl re the options 
presented? N 


From: iE O1.com> 


Date: Wednesday, April 28, 2021 at 4:27 PM 


fb.com>, 
fb.com>, 


Thanks, Nick. We've modified the draft email below to address your comments, including by a/ adding an update 
on the “disinformation dozen” and b/ restructuring it to avoid conflating the concerns that the DiCaprio meme went 


viral (a problem we're working to fix) and the issue of whether removing more content will be counterproductive to 
vaccine uptake. 


Re “Why do we believe that our judgement of the balance between removal and visibility etc is better than the 
WHO's? Whilst I’m sure our consultations have been thorough, we shouldn't lose sight of the fact that the WHO — 
despite its numerous flaws — is going to be a considerably more credible voice on these judgements than a social 
media company. At a minimum, we should explain how we would argue our case asAvhen WHO health 
professionals — and others — step up their criticisms of our approach.” --- This is a very important point. We 
approach this with a lot of humility. The challenge is that external experts disagree, and so we do have to decide 
who to listen to (and what to do with the unique insights we have about what's happening on our services and how 
users react when we remove their content). In general, external experts briefed on our approach believe that 
removing much more content might be counterproductive. This aligns with the Research team’s findings as well. 
The specific disagreements with the WHO have centered on entities that post a lot of hesitancy content. We 
believe we’ve made progress on that through our recent launch of the Dedicated Vaccine Discouraging Entity 
policy (which is discussed in the updated draft email below), but there remains work to do both to learn from the 
WHO (and others) and to keep them close. On messaging, we agree that we should not suggest we have better 
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Facebook User 

Oy Om Sd 16h 54m 
Well we'll well what do all you vaccine/masker nazis have to 
say about us anti vaxers now Huh its not funny really but how 
the heck can millions of people just jump into an experiment. 
#sheep 


2 
URGENT 


Drew Nutt updated his status. 


Oy Om 2d 17h 38m 


| now feel sorry for all of you who were vaccinated, since the 
FDA and CDC are withdrawing the Johnson vaccine due to 
blood clots... you now see why we chose not to be test 
dummys.. best of luck lab rats 


MN}}] Deena Lynn shared a post. 


pit Oy Om 5d 18h 54m 


fill 


Sharing IS caring.... everytime | see your vaccine cards proudly 
posted, | pray for your children. Stop being utter fools!! 


From: Nick Clegg ee .. 
Date: Tuesday April 2/, 2021 at 4:04 PM 


@fb.comz @fb.com> 
fb.com>, 


Subject: Re: Vaccine Policy 
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From: Nick Clegg < i@fb.com> 
Date: Tuesday. April 27, 2021 at 3:01 PM 


fb.com>, fb.com> Hii 
fb.com>, fb.com>, 
@fb.com>, i” 


@fb.com> 


Subject: Re: Vaccine Policy 


Thx for this. A few quick Qs from me before this is finalized: 


e | think we should rehearse with Mark our stance on the “12 accounts generate the majority of vaccine 
misinfo” assertion, not least since it has been made available to the team at the WH again recently by a 
group of misinfo researchers. 

e | find that the below somewhat conflates two things: a) the advice from vaccine comms experts re the 
“importance of facilitating open dialogue”; and b) the virality/prominence of vaccine discouraging content (as 
per post #3). It stretches credulity, to me at least, that that post is an important facilitator of “open dialogue”. 
It's basically satirical, after all. In other words, | think it’s perfectly logical to say that FB should play a role in 
allowing people to express their doubts, share misgivings, enter into informed dialogue etc whilst at the 
same time wishing to see FB bear down (through aggressive demotion or removal) on the wide/viral 
circulation of material that might encourage and legitimize vaccine hesitancy. To our WH interlocutors, at 
least, the suggestion that a viral Leonardo di Caprio vaccine hesitant meme is part and parcel of productive 
“open dialogue” will, not unreasonably, be viewed with considerable skepticism. So if we are going to defend 
that stance, I'd do it on different grounds (satire, open speech etc). 

e Why do we believe that our judgement of the balance between removal and visibility etc is better than the 
WHO's? Whilst I'm sure our consultations have been thorough, we shouldn't lose sight of the fact that the 
WHO -— despite its numerous flaws — is going to be a considerably more credible voice on these judgements 
than a social media company. At a minimum, we should explain how we would argue our case as/when WHO 
health professionals — and others — step up their criticisms of our approach. 


From: EE 0 fb.com> 
Date: Tuesday, April 27, 2021 at 12:00 PM 


fb.com>, 
fb.com>, 


Subject: Re: Vaccine Policy 


Please see a draft note for Mark and Sheryl with 3 stronger enforcement options against vaccine discouraging 


content here (and copied below as well) further to the discussion with Mark last week. Let us know if any feedback 
or if there’s anything missing here. 


Thanks so much, 


Subject: [For Decision] Vaccine discouraging content 


Mark, Sheryl: 
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Exactly why | am NOT getting any of these vaccines. Anyone who 
gets one right now is simply signing up for a clinical trial. You are 
essentially allowing yourself to be a guinea pig. 


Oy Om 1d 13h 36m 


| | ll | | Kathy Hughes shared a link. 


@ External Link 


PRBBM CDC, FDA Urge ‘Pause’ in Johnson & Johnson 
ionmefoh» Vaccine - Videos from The Weather Channel | 
MS weather.com 


Six women developed potentially dangerous blood 
Clots in the days after receiving the Johnson & 
Johnson COVID-19 vaccine. The CDC and FDA are 
investigating. - Videos from The Weather Channel | 
weather.com 


MITT Deena Lynn shared a post. 
anil Oy Om 5d 18h 54m 


Ut 


Sharing IS caring.... everytime | see your vaccine cards proudly 
posted, | pray for your children. Stop being utter fools!! 


From: fb.com> 
Date: Wednesday, April 21, 2021 at 5:30 PM 


Subject: Re: Vaccine Policy 


Re komments / Qs: 


e “should we schedule a follow-up meeting to discuss these options and make a decision? Or would you 
propose that we wait until the B2V classifer is running and see how the 25% demotion is performing?” 
o My view is that we should focus on executing Option 1 (status quo, 25%). It seems likely that better 
demotion coverage, rather than higher strength, will work vee keep me honest, but | 
believe that we have only manually demoted a single piece of content for being Tier 1 B2V so far (and 
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it wasn't the DiCaprio meme). There's active work to scale this up — both manually and to build 
classifiers. If we find that 25% strength (with good coverage) isn’t working to keep B2V content out of 
the Top N, then we can turn up to 50% (but I'd still argue for giving notice, because | don't like taking 
such strong action without any transparency or accountability). 

e ‘| dont see any reason not to reach out to Heidi Larson and other panel members to understand whether 
they would be willing to speak out more publicly and/or privately with the White House” 

© We'll reach out to Heidi and others to get of sense of their comfort speaking w/ or being mentioned to 
the WH. 

e “What is Nick able to share about this work with Andy Slavitt without reaching out to the panel members? 
Can identify institutions/participants? Can he say that that we received this feedback from the “High Level 
Panel on Vaccine Confidence & Misinformation” organized by the London School of Hygiene and Tropical 
Medicine and the Center for Strategic and Intemational Studies?” 

° just briefed a few of us on his convo today with Rob at the WH. BB pou keep me 
nest, but it sounds like (surprisingly) Rob generally agreed with our reduce & inform approach here. 
He shared the concern removing too much content would be counterproductive b/c it would 1/ prevent 
hesitant people from talking through their concerns and 2/ reinforce the notion that there’s a cover-up 
(a key prong of anti-vax narratives). aid that we've discussed this with independent experts, but 
did not name names or affiliations. | think Nick should do the same in his next call with Andy (unless 
we hear back from some of these experts in time and they want to be referenced). 


From: i ob com> 


Date: Wednesday, April 21, 2021 at 5:03 PM 


@fb.com>, 


Subject: RE: Vaccine Policy 


Yes, here’s the YouTube comparison: https://docs.google.com/document 
/d/ImENS5sOhuw9gX8iY 2xwiYO8Vwt4t1gAGAS-QQcmT 1nQc/edit?usp=sharing 


From: © 0.com- 


Sent: Wednesday, April 21, 2021 3:57 PM 


Subject: Re: Vaccine Policy 


Thanks — should we schedule a follow-up meeting to discuss these options and make a decision? Or would you 
propose that we wait until the B2V classifer is running and see how the 25% demotion is performing? Personally 
going to 50% without specific notice seems pretty no-regrets to me (though obviously we'll have issues if the 
classifier precision isn't great). 


| don't see any reason not to reach out to I anc other panel members to understand whether they 
would be willing to speak out more publicly and/or privately with the White House — think we should just do that. 
What is Nick able to share about this work with Andy Slavitt without reaching out to the panel members? Can 
identify institutions/participants? Can he say that that we received this feedback from the “High Level Panel on 
Vaccine Confidence & Misinformation” organized by the London School of Hygiene and Tropical Medicine and the 
Center for Strategic and International Studies? 


Ero are you working on the YouTube comparison — let me know if | can help. That seems like the 
other urgent thing to make sure that Nick feels prepared to talk to Andy. 


From: SO tb com> 
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Date: Wednesday, April 21, 2021 at 3:33 PM 


Subject: Re: Vaccine Policy 


Thanks, a. prepared this doc (also attached) to address action items #1, #2, and #3 below. Here’s the 
TL;DR: 

1. We do not currently automatically demote vaccine discouraging / barrier to vaccination content at scale 
(although we are working on classifiers to do so). 

2. Last week, for the first time, we started to demote by 25% the most severe, nonviolating vaccine 
discouraging content (“Sensational or Alarmist Vaccine Content” and “Criticizing the Choice to 
Receive/Provide Vaccines”) on escalation only. Since this approach is new, we do not know if this will keep 
such content out of the Top N vaccine content. 

3. While we are facing pressure to remove more content from certain external stakeholders, the general (not at 
all unanimous) view of vaccine communication experts is that us removing more expressions of vaccine 
hesitancy might be counterproductive to the goal of vaccine uptake, because it would: 1/ prevent hesitant 
people from talking through their concerns and 2/ reinforce the notion that there’s a cover-up (a key prong of 
anti-vax narratives). 

4. This doc presents four options for addressing Tier 1 vax-discouraging / “barriers to vaccination” (B2V) 
content: 


i. Maintain the status quo / 25% demotion 
ii 50% demotion + give user specific notice when we demote 
ili 50% demotion, no specific user notice (general notice via Help Center) 


IV. Remove this content 


From SIO tb com> 


Date: Wednesday, April 21, 2021 at 2:36 PM 


@fb.com>, | : @fb.com>, 


@fb.com>, 


Subject: Vaccine Policy 


Just realized that | hadn't sent notes/next steps. Apologies if I’ve missed follow-up on any of these. | think the most 
urgent things for Nick’s next conversation with Andy Slavitt are #1, #3, and #5. It hasn’t been scheduled yet but 
would be good to know ETA on these items. 


1. <= frame proposal for stronger demotions for a broader range of B2V content. | think this is 
pretty urgent — do we have an update on going to 50% and potentially going beyond T1? 


_ i: describe policy that would result in removal of much more content. Based on most recent 
interactions with White House, | think this feels slightly lower priority but still worthwhile. 


3. | provide context about guidance we've received from health experts (with information about 
who those experts are) to reduce/inform rather than remove. Do we have update? 


4 Ee pioring introducing more friction in connection with inform/reduce. | think we are also looking at 
whether we can supplement our current inform approach with content specifically designed to reach vaccine- 
hesitant communities. Any updates here? 
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5. BSS335s provide comparison of our policies and YouTube's policies. 


From: Of com 


When: 2:00 PM - 2:30 PM April 19, 2021 
Subject: Vaccine Policy 
Location: 


Join Zoom aa 


Meeting i 


Passcode: 
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Exhibit 32 


Email correspondence between 
Facebook and the White House 


345 


From: HM <0 = THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO 
Sent: 5/10/2021 4:48:57 PM 
Subject: Re: [EXTERNAL] FW: COVID Genomic Sequencing 


Rob—sorry for the delay. Responding on your questions below. VVe'll also come back to you with more details on 
your question around demotions—will have be‘ter context for you in a day or so to better explain what's happening 
when we demote content but wanted to get as much as | had to you tonight. Additionally—tomorrow we're 
planning to some comms around our efforts around Covid—will send that in a separate message and will include 
Courtney as well. 


We looked into why that post had so many views despite having so few comments and firstly, the original poster 
(“Dee Block’) only allows friends or friends-of-friends to comment on their posts, or they've turned commenting 
off. The post, along with many memes on the site, was likely snared amongst people from within existing networks 
- i.e. from friends sharing with each other or people sharing in Groups. 


You also raised some questions around groups. VVe have strong policies against false claims about COVID and 
vaccines that we enforce - and when a Page, Group, or account repeatedly viclates these policies we enforce 
penalties against them, including removing entities that repeatedly break our rules from cur platforms. On at least 
11 separate occasions, individuals identified by the CCDH have had a presence on Facebook or Instagram 
permanently removed for violating our COV!D-19 or vaccine misinformation policies. 


Our automated detection uses a variety of signals to identify groups that might be dedicated to vaccine 
discouragement regardiess of the group name. so we are reviewing groups with high volumes of this content that 
don't necessarily have vaccine or health specific topics in their name. We have taken down a number of entities 
with high follower count since the launch of this policy who:are clearly dedicated to promoting borderline content - 
for example, we removed an IG profile called “Rise up Melbourne” with 11k followers, and a Facebook group called 
“Reopen Alabama” with 34k members. 


We're working to get you the next Top 100 report by Friday and note your question about which of these we’re 
promoting to try and include in this iteration, 


more to come shortly. 


From: Flaherty, Rob EOP/WHO SEE own. cop.gov> 
Date: Friday, May 7, 2021 at 10:56 AM 

To: EE o> .com- 

Subject: RE: [EXTERNAL] FW: COVID Genomic Secuencing 


Yeo — knew about this one. Thanks for flagging. 


From: i 6 tb .com> 


Sent: Friday, May 7, 2021 10:41 AM 
To: Flaherty, Rob EOP/WHO <i Qwino.eop.cov> 
Subject: Re: [EXTERNAL] FW: COVID Genomic Sequencing 


Hey—sorry for delay in response—working on getting something back to you today with answers to below. Also 
wanted to flag that we are talking to HHS this afternoon about the potential to build_a text based vaccine finder bot 
on WhatsApp, similar to the one launched last week for SMS. This came through RE 2c: to our WA 
team—wanted to make sure you had visibility. 
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From: Flaherty, Rob EOP/WHO EEE © ::.0.c0p.90v> 


Date: Thursday, May 6, 2021 at 2:17 PM 
To: ES f.com> 
Subject: RE: [EXTERNAL] FW: COVID Genomic Sequencing 


So | guess | have two questions here: 


1. He references the “three” widest reach posts, of which! believe this Is one: >httos:/Awwwtacebook.com 
(DeeBlock253/posts/3528944520539 112< 


For one, it's still up and seems to have gotten pretty far. And it's got 365k shares with four comments. We've 
talked about this in a different context, but how does something like that happen? The top post, the one from the 
Wisconsin news station, has 2.1 million comments. Am | looking at one instance of sharing (so, one of the 365,000 
shares} or is this genuinely a post that has been shared nearly 400,000 times but only four people commented on 
it? What is your assessment of what is going on here? 


Won't come as a shock to you that we're particularly interested in your demotion efforts, which | don't think we 
nave a good handle on (and, based on the below, it doesn't seem like you do either}. Not to sound like a broken 
record, but how much content Is being demoted, and how effective are you at mitigating reach, and how quickly? 
As I've said, | don't think our position is that you should remove vaccine hesitant stuff. However, slowing it down 
seems reasonable. | just can't describe what it means or how you know its working. : 


Also, health groups: sure. But it seems more likely that anti-vax stuff is movingin groups that are not about health 
put are... mom centric, or other spaces. Strikes me as the issue here fs: less from single-use anti-vaccine accounts 
and more about people who...do other things and are also vaccine hesitant. Seems like your “dedicated vaccine 
nesitancy” policy isn't stopping the disinfo dozen — they're ee. deemed as not dedicated -- so it feels like that 
oroblem likely carries over to groups. 


As a last thing, I’c be interested in seeing this 100 ranking in terms of reach from things that you aren't actively 
promoting in the info panel. EG: the unicef one's reach is because you're putting it in a big, giant box that says 
“Facebook” on it, versus the way it distributes naturally, 


From: fb.com> ° => 

Sent: Saturday, May 1,20212:10 PM 

To: Flaherty, Rob EOP/WHO < who.eop.gov> 
Subject: FW: [EXTERNAL] FW:.COVID Genomic Sequencing 


Making sure you see this from Nick to Andy as well--around anytime to discuss any and all things... 


From: Nick Clegg RB 210. com> 


Date: Saturday, May 1, 2021 at 1:53 PM 


ug Slavitt, Andrew M. EOP/WHO <iiiEIowho. eop.gov> 


fb.com> 
Sabet Re: [EXTERNAL] FW: COVID Genomic Sequencing 


Hi Andy, 


Thanks to your team for sharing the research work with us - the team have spent some time reviewing these and | 
wanted to send over some details on where we're developing work in this space (and where we aren't). 


Firstly, | know [has sent the latest version of the Top 180 content report to Rob yesterday evening and | 
wanted to send you a quick note on the three pieces of vaccine content that were seen by a high number of people 
before we demoted them. Although they don't violate our community standards, we should have demoted them 
before they went viral and this has exposed gaps in our operational and technical process. 
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The teams have spent the last 24 hrs analysing these gaps and are making a number of changes starting next 
week, including setting up more dedicated monitoring for Covid vaccine content on the cusp of going viral, applying 
stronger demotions to a broader set of content, and setting up daily review and analysis so that we have a better 
real-time view of what is being seen by lots of people. | will be checking on this closely to make sure that these 
additional steps show results - the stronger demotions in particular should deliver real impact. Please let me know if 
you'd like to discuss any of this in more detail. 


Returning to the points raised by the research - much of this is fair comment and actually includes many of the 
integrity efforts we've already deployed and are actively improving on, or are related to planned launches in the 
coming months. 


Non-English mis/disinformation circulating without moderation (Spanish, Arabic, Chinese, among others) 
and; ISD reports evidence of the global threat that anti-vaccination disinformation and misinformation 
represents across languages and borders: Rolling our efforts out globally and in other countries will take us 
some time, given the complexity and scale - we think that this will take a number of months before we've fully 
scaled this work and we are prioritizing languages where we know vaccine hesitancy is likely to be higher based on 
external data. 


Do not distribute or amplify vaccine hesitancy, and Facebook should end group recommendations for 
groups with a history of COVID-19 or vaccine misinformation: Much of the esearch you shared called on us to 
ensure that our systems don't amplify vaccine hesitancy content and this is top of.mind for us. In addition to the 
changes | mentioned above, we have already removed all health groups from:our recommendation feature on 
Facebook, and on Instagram we filter vaccine-related accounts from our “accounts you may follow feature”. We 
also remove accounts that may discourage vaccination from search featurés. We currently enforce on hashtags 
we know are shared to promote vaccine hesitancy content and are working to improve our automated systems 
here. te Rae 


Monitoring events that host anti-vaccine and COVID disinformation: From our analysis, events do not make up 
a high proportion of borderline vaccine content that people'see on Facebook right now, but we are working to 
improve automatic detection for events hosting anti-vaccine and COVID content. Our viral monitoring efforts will 
also help us detect events that are gaining views on Facebook, and we do remove events coordinating in-person 
gatherings that involve or encourage people who have COVID-1 to join. 


12 accounts are responsible for 73% of vaccine misinformation: Lastly, we continue to review accounts 
associated with the 12 individuals identified in the CCDH “Disinformation Dozen” report, but many of those either 
do not violate our policies or have ceased posting violating content. Our “Dedicated Vaccine Discouraging Entity” 
policy is designed to remove groups and pages that are dedicated to sharing vaccine discouraging content and we 
continue to review and enforce on these where we become aware of them. 


| realise that our position on this continues to be a particular concern for you which Is why our teams regularly 
engage with a range of experts to check whether we are striking the right balance here. In early March, for instance, 
we discussed our planned approach with members of the “High Level Panel on Vaccine Confidence & 
Misinformation” (organized by London School of Hygiene and Tropical Medicine and the Center for Strategic and 
International Studies) and we have checked more recently with Heidi Larson of the Vaccine Confidence Project 
too. 


Among experts we have consulted, there is a general sense that deleting more expressions of vaccine hesitancy 
might be more counterproductive to the goal of vaccine uptake because it could prevent hesitant people from 
talking through their concerns and potentially reinforce the notion that there’s a cover-up (especially, though not 
exclusively, in the US). Given how complicated this continues to be, especially due to the recent news cycle about 
the safety of some vaccines, we will of course continue to speak with experts on our position here and adapt our 
approach as needed. 


Hope this update is helpful — and obviously I’m happy to speak any time. 


Best 
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Nick 


On 4/27/21, 3:33 AM, “Slavitt, Andrew M. EOP/WHO" TEE: »10.200.g0v> wrote: 
Thanks Nick. | assume you may have staff there. | hope they are well. 
Sent from my iPhone 


> OnApr 27, 2021, at 12:11 AM, Nick Clegc <iiiatb.com> wrote: 

> 

> Hi Andy 

> 

> | know youlre focusing on India a fair amount. Just fyi, we're doing the following: 

> 

> - Amplifying localized authoritative information and services specific to this crisis (e.g., symptom triage 
information / when to go or not go to a hospital given systems are overwhelmed} on platform and via ad credits; 

> - Activating WhatsApp Bots for symptom tracking and to connect users to nearby health resources; 

> - Curating relevant content across CIC, News, and Latest Updates for India; 

> - Proactively reviewing misinformation content in English, Hindi, and Bengali; and 

> - Making an up to $10M financial contribution to support some immediate needs in country (e.g., extending 
medical supplies to underprivileged, augmentirg oxygen supply ibaa ete.) 

> a a 

> And Mark is keen to see what more we can do 

>> >>https:/Awww.facebook.com/zuck/posts! 10112926954780791%430%3C< 

> 

> Brian & team are in touch with USAID - but don't hesitate to point us to other next steps where we could be 
nelpful. *, 
> We also received the recommendations/observations from the research organizations you met re covid 
misinfo etc this afternoon - the teams are now looking at them carefully, and I'l get back to you once that's done. 
> gO Se 
> Best 
> 
> Nick 
> On 4/22/21, 7:23 PM, "Slavitt, Andrew M. EOP/WHO" ¢ @who.eop.gov> wrote: 
I will arrange a call. Please let Bow the information on who to include. Thanks 


> 
> 
> Sent from my iPhone 
> 


>> On Apr 22, 2021, at 7:58 PM, Nick Clegg <M fb.com> wrote: 


>> 

>> Hi Andy 

>> 

>> As promised, more info from Priscilla Chan below and slides re the CZI work attached. De tell me how an 
useful connection can be made. 

>> 

>> Thx 

>> 

>> Nick 

>> 

>> 

>> Thanks for looking into this. CZI has been working in this area since before the pandemic. We built IDSeq 
(Link<>>>=https:/Awww.discoveridseg.conv<<; < <>and technical write up attached) to sequence unknown 
pathogens and then adapted it to do genomic sequencing for COVID and California Departments of public health. 
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Right now we are working with local departments that are deploying these funds to build up their internal capacity. 
However, we can't figure out if there is a centralized vision of how all of these individual efforts are supposed to 
come back together and if they do what the public officer facing tool is. Slides on the issue we are trying to 
address is also attached. 

>> 

>> Would love to try to learn about any central plan to ensure that our work ends up being compatible and share 
back any learning if helpful. 
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Exhibit 33 


Email correspondence between 
Facebook and the White House 


From: i Rob EOP/WHO RR 1110. 20p.gow 


To: 
Sent: 4/23/2021 2:27:09 PM 
Subject: Research Suggestions 


Here's the crux of their recs. Don't read this as White House endorsement of these suggestions (or, also, as the 
upper bound of what our thoughts on this might be). But — spirit of transparency -- this is circulating around the 
duilding and informing thinking. 


Facebook COVID-19 Vaccine Misinformation Brief 


Facebook plays a major role in the spread of COVID vaccine misinformation 


e Supporting documents from research compiled by Media Matters, GOR, Institute for Strategic Dialogue 
(ISD) and others overviews a range of mis-/dis-information narratives still circulating on Facebook and 
Facebook-owned properties like Instagram, as well as evasion tactics or deficiencies in detection efforts. 
Highlights include: 

e Failure to monitor events hosting anti-vaccine and COVID disinformation 

e Influencers, pages, and accounts who violate Facebook's policies and are removed or penalized can 
easily take their disinformation and agenda to one of their other account properties on the same 
platform or to their account on another Facebook owned platform like Instagram. 

e Coded language, misspellings, images, disappearing stories, direct to camera videos, and hashtag 
hijacking pushing cis/misinformation into public and closed spaces and attracting people into closed 
groups flooded with mis/disinformation 

e Directing attention to COVID-skeptics/anti-vaccine “trusted” messengers (doctors, gurus, celebrities, 
ir-community experts) as well as Facebook groups masking their easily observed promotion of 
anti-vaccine disinformation 

¢ Nor-English mis/disinformation circulating without moderation (Spanish, Arabic, Chinese, among 
others) 

e Given how mis/disinformation moves across borders, moderation failures in other country settings 
pose a risk to Americans as well. SD reports evidence of the global threat that anti-vaccination 
disinformation and misinformation represents across languages and borders. ISD research also 
highlighted the threat that anti-vaccination disinformation on social media might have on real-world 
vaccination sites. 


Facebook's policy and enforcement gaps enable misinformation’s spread 


e 12 accounts are responsible for 73% of vaccine misinformation on Facebook. Transparent, progressively 
severe penalties (similar to those in Twitter's civic integrity policy) and comprehensive enforcement for 
pages, accounts, and groups that repeatedly post COVID vaccine misinformation would effectively promote 
behavior change and affect only a small number of accounts. Bans for COVID-19 misinformation should be 
cross-platform and enforced at the entity-level, not the account level. 

e Even if Facebook thinks anti-vaccine disinformers have successfully skirted its rules to avoid deplatforming, 
the company is under no obligation to distribute or amplify anti-vaccine or vaccine-hesitant propaganda in 
News Feed or in group recommendations. Incorporating objective signals of source authority into News 
Feed for health content, like Facebook's previously deployed News Ecosystem Quality scores-- would 
significartly reduce the reach of low-quality domains used by prominent anti-vaxxers. Similarly, Facebook 
should end group recommendations for groups with a history of COVID-19 or vaccine misinformation. 

e Vaccine misinformation monitoring and enforcement must adjust as disinformers evade enforcement with 


Equality Labs suggests nor-English-speaking diaspora communities are disproportionately subjected to 
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dangerous COVID-19 and vaccine related disinformation. Facebook should direct resources to equal policy 
enfercemert around violative content and networks in nor-English languages. 

« Warming screens before linking to domains known to promote vaccine misinformation would dissuade users 
from following links to off-platform misinformation and hurt the vaccine-misinformation business model 
Facebook enables. 


Rob Flaherty 

Director of Digital Strategy 
The White House 

Cell: 
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Exhibit 34 


Internal Facebook email 
correspondence 


354 


From /O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=8E98834A8DAB4AA28B1 A5SCOB9BE6C555> 

To: Nick Clegg; 

cc: 

Sent: 4/30/2021 7:03:13 PM 

Subject: Re: Research Suggestions 


Yes of course — will make these edits and send back over to you for first thing tomorrow 


thanks 


From: Nick Clegg <{i@fb. com> 
Date: Friday, April 30, 2021 at 7:00 PM 


Subject: Re: Research Suggestions 


And maybe also a para on the advice we have been receiving on the merits of wider removal - Andy’s stance is in 
favor of more removal so showing that we have been thoughtful rather than dismissive of that is important. Thx! N 


Get Outlook for iOS 


From: Nick Clegg HD b.com> 
Sent: Friday, April 30, 2021 6:56:26 PM 


fb.com>; Dfb.com> 


: Research Suggestions 


Thx v much if you don't mind, would you mind enumerating the responses under the separate headings of 
the points made by the researchers roughly as per your earlier email thread? Andy is not across all the detail and | 
think it would help demonstrate to him that we are being comprehensive in our response. Plse don’t mess up your 
Fri evening if it’s getting too late — | can send trrw morning too. 


N 


From: Ef com> 


Date: Friday, April 30, 2021 at 6:50 PM 
To: Nick Clegg 


- smaller thread, 


Nick, per our chat please see a draft note for you to send to Andy once fi 2s sent the report to Rob: 
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Andy, 


Thanks to your team for sharing the research work with us - the team have spent some time reviewing these and | 
wanted to send over some details on where we're developing work in this space (and where we aren't). 


Firstly though, | know has sent the latest version of the Top 100 content report to Rob this evening and | 
wanted to send you a quick note on the three pieces of vaccine content that were seen by a high number of people 
before we demoted them. Although they don't violate our community standards, we should have demoted them 
before they went viral and this has exposed gaps in our operational and technical process. 


We've spent today analysing these gaps and are making a number of changes starting next week, including setting 
up more dedicated monitoring for Covid vaccine content on the cusp of going viral, applying stronger demotions to 
a broader set of content, and setting up daily review and analysis so that we have a better real-time view of what is 
being seen by lots of people. | will be checking on this closely to make sure that these additional steps show 
results. Please let me know if youd like to discuss any of this in more detail. 


Returning to the points raised by the research - much of this is fair criticism and actually includes many of the 
integrity efforts we've already deployed and are actively evolving or improving on, or are planned launches in the 
coming months. Rolling these efforts out globally and in other countries will take us some time, given the 
complexity and scale - we think that this will take a number of months before we've fully scaled this work and we 
are prioritizing languages where we know vaccine hesitancy is likely to be higher based on external data. 


Much of the research you shared called on us to ensure that our systems don't amplify vaccine hesitancy content 
and this is top of mind for us. In addition to the changes | mentioned above, we have already removed health 
groups from our recommendation feature on Facebook, and on Instagram we filter vaccine-related accounts from 
our “accounts you may follow feature”. We also remove accounts that may discourage vaccination from search 
features. We currently enforce on hashtags we know are shared to promote vaccine hesitancy content and are 
working to improve our automated systems here. 


Facebook right now, but we are working to improve automatic detéCti@p for events hosting anti-vaccine and 
COVID content. Our viral monitoring efforts will also help us detect evertts that are gaining views on Facebook, and 
we do remove events coordinating in-person gatherings that involve or encourage people who have COVID-19 to 
join. 


From our analysis, events do not make up a high proportion of maths ne content that people see on 


Lastly, we continue to review accounts associated with the 12 individuals identified in the CCDH “Disinformation 
Dozen” report, but many of those either do not violate our policies or have ceased posting violating content. Our 
“Dedicated Vaccine Discouraging Entity” policy is designed to remove groups and pages that are dedicated to 
sharing vaccine discouraging content and we continue to review and enforce on these where we become aware of 
them. 


We're grateful for the engagement with you and your team on these difficult issues and appreciate the information 
shared with us - please do send other research findings with us 


From: i b.com> 


Date: Thursday, April 29, 2021 at 3:35 PM 


OTD com> 


Of com>, ET fb.com> 
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number of people who see vaccine misinformation content. 


From: @fb.com> 
Date: Thursday, April 29, 2021 at 3:29 PM 


Subject: Re: Research Suggestions 


From: Nick Clegg @fb.com> 
Date: Monday. April 26.2021 at 9:13 PM 


Dtb.com>, 


Subject: Re: Research Suggestions 


I’ve told Andy Slavitt I'll get back to him once we've had a chance to a, and respond. 


Thx 


N 


From: i t.com> 
Date: Monday, April 26, 2021 at 5:5 
Ofb.com>, . O@fb.com>, 
@fb.com>, 


Ce: 
Subject: FW: Research Suggestions 


Rob shared the researcher info with us—sending for a review so that Nick can get back to 
Andy. Sending with Rob’s context as well 


Here’s the crux of their recs. Don't read this as White House endorsement of these suggestions (or, also, as the 
upper bound of what our thoughts on this might be). But — spirit of transparency -- this is circulating around the 
building and informing thinking. 
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Exhibit 35 


Internal Facebook email 
correspondence 


362 


From: <0. = THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
oP ENE rr NTE Ona Seen ae AOE 


To: 
Sent: 4/28/2021 4:58:28 PM 
Subject: Re: Research Suggestions 


Thanks, a - It looks good to me. | added a couple comments, but otherwise it's good to go. 


From: fb.com> 
Sent: Wednesday, April 28, 2021 5:28 PM 
To: fb com> io tb com> 


Subject: FV: Research Suggestions 


FY! for you— here is the draft note back to Nick on the research suggestions update from the WH - 
https://fb.quip.com/a3RMALrFgohm 


I'm waiting for fto look and update on some of the product work but would love any edits/thoughts you have 


From: fb.com> 
Date: Wednesday, April 28, 2021 at 2:24 PM 


Subject: Re: Research Suggestions 


Thanks would love your thoughts/additions on the doc on the product side when you have a 
moment so we can go back to Nick later today? 


From: i of com> 


Date: Wednesday, April 28, 2021 at 10:33 AM 


To: fb.com>, fb.com>, i @fb.com>, 
fb.com>, fb.com> 
Cc: i fb .com> 


Subject: Re: Research Suggestions 


The disinformation dozen report that is cited multiple times is the one | spent time this morning. The 
methodology of how they determined the 12 accounts and the 71% estimate of responsibility is not 
something | would stand behind from a research design perspective. | do however thing there can be 
problematic patterns with these accounts, | am not saying these are likely benign entities. 


lam now going to spend some time with the report about the latinx population. 


From: fb.com> 
Sent: Wednesday, April 28, 2021 8:54 AM 


pb or i © com> 


@fb.com> 


363 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0058880 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


| had not looked at it before - taking a look now, as well as at the draft back to Nick. 


From: Mfb.com> 

Sent: Wednesday, April 28, 2021 7:47 AM 
To: fb.com>; 
fb.com> 
Ce: fb.com> 
Subject: Re: Research Suggestions 


— 


fb.com> 


running down what is net new now. 


- have we looked at this report before and do we have any thoughts on their methodology (even just for 
internal purposes)? 


Get Outlook for iOS 


From: fb.com> 
Sent: Tuesday, April 27, 2021 6:46:46 PM 


fb. com>; TT ©fb.com> il 


fb.com> 


Subject: Re: Research Suggestions 


Sorry for my delay here. Here’s a draft note back to Nick etc (please don't add others here directly) - 


| actually answered the points line by line which may be overkill so let me know if you all think we 
should revert to a format likefJ that’s higher level? | think I've answered your a) and b) questions in there 
though. 


From: I 1.com> 


ril 27, 2021 at 2:22 PM 


Subject: Re: Research Suggestions 


Thanks for forwarding. Sy 


Apologies if this is already happening, but do we think it'd be useful to go through the points below and do a quick 
breakdown on substance? If so who's on doing this? 


Something like: 

a) We think the point is factually incorrect, e.g. "Facebook should end group recommendations for groups with a 
history of COVID-19 or vaccine misinformation” --> we already don't recommend health groups, full stop, and think 
this is high recall (need to confirm recall point). 

b) We think the point is a fair criticism and will address soon, e.g. "Transparent, progressively severe penalties 
groups that repeatedly post COVID vaccine misinformation would effectively promote behavior change and affect 
only a small number of accounts." --> hopefully addressed by the superspreader work. 

c) We think the point is a fair criticism but will not address soon (and why), e.g. "Bans for COVID-19 
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misinformation should be cross-platform and enforced at the entity-level, not the account level." --> clear defense 
as to why (assuming we net out here vs. in (b)). 


That could help us orient our overall response, plus build trust if in 1 mo we've addressed most of the things in (a) 
and (b) above plus can transparently explain the things in (c). It would also be helpful to get the supporting 
documents they reference directly for this (e.g. ISD, GQR, Media Matters). 


From: TE 1 com> 
Sent: Tuesday, April 27, 11:10 PM 


To: fb.com> 
Subject: FW: Research Suggestions 


FY| 


fb.com> 
April 26, 2021 at 5:55 PM 


Subject: FW: Research Suggestions 


Rob shared the researcher info with us—sending for a review so that Nick can get back to 
Andy. Sending with Rob’s context as well 


Here’s the crux of their recs. Don't read this as White House endorsement of these suggestions (or, also, as the 
upper bound of what our thoughts on this might be). But — spirit of transparency -- this is circulating around the 
building and informing thinking. 


Facebook COVID-19 Vaccine Misinformation Brief 


Facebook plays a major role in the spread of COVID vaccine misinformation 


e Supporting documents from research compiled by Media Matters, GQR, Institute for Strategic Dialogue 
(ISD) and others overviews a range of mis-/dis-information narratives still circulating on Facebook and 
Facebook-owned properties like Instagram, as well as evasion tactics or deficiencies in detection efforts. 
Highlights include: 

e Failure to monitor events hosting anti-vaccine and COVID disinformation 

e Influencers, pages, and accounts who violate Facebook's policies and are removed or penalized can 
easily take their disinformation and agenda to one of their other account properties on the same 
platform or to their account on another Facebook owned platform like Instagram. 

e Coded language, misspellings, images, disappearing stories, direct to camera videos, and hashtag 
hijacking pushing dis/misinformation into public and closed spaces and attracting people into closed 
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groups flooded with mis/disinformation 

e Directing attention to COVID-skeptics/anti-vaccine “trusted” messengers (doctors, gurus, celebrities, 
in-community experts) as well as Facebook groups masking their easily observed promotion of 
anti-vaccine disinformation 

e Non-English mis/disinformation circulating without moderation (Spanish, Arabic, Chinese, among 
others) 

e Given how mis/disinformation moves across borders, moderation failures in other country settings 
pose a risk to Americans as well. ISD reports evidence of the global threat that anti-vaccination 
disinformation and misinformation represents across languages and borders. |SD research also 
highlighted the threat that anti-vaccination disinformation on social media might have on real-world 
vaccination sites. 


Facebook’s policy and enforcement gaps enable misinformation’s spread 


e 12 accounts are responsible for 73% of vaccine misinformation on Facebook. Transparent, progressively 
severe penalties (similar to those in Twitter's civic integrity policy) and comprehensive enforcement for 
pages, accounts, and groups that repeatedly post COVID vaccine misinformation would effectively promote 
behavior change and affect only a small number of accounts. Bans for COVID-19 misinformation should be 
cross-platform and enforced at the entity-level, not the account level. 

e Even if Facebook thinks anti-vaccine disinformers have successfully skirted its rules to avoid deplatforming, 

the company is under no obligation to distribute or amplify anti-vaccine or vaccine-hesitant propaganda in 

News Feed or in group recommendations. Incorporating objective signals of source authority into News 

Feed for health content, like Facebook's previously deployed News Ecosystem Quality scores-- would 

should end group recommendations for groups with a history of COVID-19 or vaccine misinformation. 

Vaccine misinformation monitoring and enforcement must adjust as disinformers evade enforcement with 


Equality Labs suggests non-English-speaking diaspora communities are disproportionately subjected to 
dangerous COVID-19 and vaccine related disinformation. Facebook should direct resources to equal policy 
enforcement around violative content and networks in non-English languages. 

Warning screens before linking to domains known to promote vaccine misinformation would dissuade users 
from following links to off-platform misinformation and hurt the vaccine-misinformation business model 
Facebook enables. 


Rob Flaherty 

Director of Digital Strategy 
The White House 

Cell: 
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Exhibit 36 


Internal Facebook email 
correspondence 
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Message 


From: 0 =THEFACEBOOK/OU=EXTERNAL 
(FYDIBOHF25SPDLT)/CN=RECIPIENTS/CN=B73E73BCAECO4FA7972116B731F6EB67] 


Sent: 4/30/2021 7:58:54 AM 
To: fb.com] 


Subject: Re: Vaccine Policy 

Attachments: jimage001.png; image002.png; image003.png; image004.png; image005.png; image006.png; imageO07.png; 
imageO08.png; image009.png; image010.png; image011.png; image012.png; image013.png; image014.png; 
imageO15.png; imageO16.png; image017.png; image018.png; image019.png; image020.png; image021.png; 
image022.png; image023.png; image024.png; image025.png; image026.png; image027.png; image028.png 


I'm comfortable with Option 2. 


(Since we’re still not actually demoting hardly any content at 25%, I’d prob vote for “Actually execute Option 1 and see if 
it works to keep B2V out of Top 1000. If not, do Option 2”. But | think a steer that Option 2 is ok allow us to go down 
that path.) 


For: II © 2 com> 


Date: Thursday, April 29, 2021 at 9:41 PM 


Subject: Fwd: Vaccine Policy 
Where are you guys? 2 sorta seems like the right place to be here, all things considered. 


Get Outlook for iOS 


From: (IE © fb.com> 


Sent: Thursday, April 29, 2021 10:40 PM 
To: Nick Clegg; 
Cc: 
Subject: Re: Vaccine Policy 


Apologies for the delay here - we're working to collect views from XFN teams so we can include that in the note for Mark 
and Sheryl and will come back to you on this tomorrow 


Thank you 


Get Outlook for iOS 


From: Nick Clegg <i fb.com> 


Sent: Wednesday, April 28, 2021 9:33:27 PM 
To: © f>.com>; © fb.com> iM fb.com>; iy 
B® fb.com>; fb.com>; TT fb. on> iii 

B® fb.com>; fb.com> 
Cc: 


fb.com>; fb.com>; 
fb.com>; I fb.com>; fb.com>; 


EE 2 6:01 >; © (com> 


Subject: Re: Vaccine Policy 


Thanks — and would we accompany this with a team recommendation for Mark and Sheryl re the options presented? N 
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From: fb.com> 
Date: Wednesday, April 28, 2021 at 4:27 PM 


fb.com>, IT © fb.com> 


Subject: Re: Vaccine Policy 


Thanks, Nick. We’ve modified the draft email below to address your comments, including by a/ adding an update on the 
“disinformation dozen” and b/ restructuring it to avoid conflating the concerns that the DiCaprio meme went viral (a 
problem we’re working to fix) and the issue of whether removing more content will be counterproductive to vaccine 
uptake. 


Re “Why do we believe that our judgement of the balance between removal and visibility etc is better than the WHO’s? 
Whilst I’m sure our consultations have been thorough, we shouldn’t lose sight of the fact that the WHO — despite its 
numerous flaws — is going to be a considerably more credible voice on these judgements than a social media company. At 
a minimum, we should explain how we would argue our case as/when WHO health professionals — and others — step up 
their criticisms of our approach.” --- This is a very important point. We approach this with a lot of humility. The 
challenge is that external experts disagree, and so we do have to decide who to listen to (and what to do with the 
unique insights we have about what’s happening on our services and how users react when we remove their content). In 
general, external experts briefed on our approach believe that removing much more content might be 
counterproductive. This aligns with the Research team’s findings as well. The specific disagreements with the WHO have 
centered on entities that post a lot of hesitancy content. We believe we’ve made progress on that through our recent 
launch of the Dedicated Vaccine Discouraging Entity policy (which is discussed in the updated draft email below), but 
there remains work to do both to learn from the WHO (and others) and to keep them close. On messaging, we agree 
that we should not suggest we have better judgment than the WHO (or CDC or Vaccine Confidence Project). In 
messaging, we should lean into the fact that we work with lots of experts to constantly calibrate our approach as the 
pandemic evolves, content trends emerge, and our products improve. 


UPDATED DRAFT EMAIL 
Subject: [For Decision] Vaccine discouraging content 
Mark, Sheryl: 


We are facing continued pressure from external stakeholders, including the White House and 
the press, to remove more COVID-19 vaccine discouraging content. For example, we recently 
week of 4/5-4/417. While authoritative information dominated the list, the White House was 
concerned that the #3 post was a vaccine discouraging humorous meme, and they called on us 
to delete the meme. We didn't appropriately catch-and-demote this meme (and it shouldn't be 
removed as it’s humorous/satirical and arguably true). Still, this incident prompted us to take 
another hard look at our approach and to seek your guidance on whether to take more 
aggressive action against certain vaccine discouraging content. 


As you know, we currently remove content that includes certain misinformation about covid and 
vaccinations (e.g., the covid vaccine has microchips) and content that explicitly discourages 
vaccination (e.g., the COVID-19 vaccine is too dangerous - don't get it!). 


More broadly, we aim to reduce vaccine discouraging content, namely ‘sensational or alarmist 
content’ (e.g., vaccines are the work of the devil; these vaxx are so bad for your body!) and 
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‘criticism of personal vaccine choices’ (e.g., it's child abuse to give your kid the vaccine; you'd 
have to be a complete moron to get vaccinated). 


To reduce this content, we are currently building systems to review & demote on escalation, and 
over time hope to have demotions at scale through classifiers (although that kind of scaled 
enforcement is likely to be challenging). We are not convinced we'll be able to catch all kinds of 
this content quickly enough before it gains some distribution. Additionally, given people's 
interest in the topic, weaker demotions may not be sufficient to meaningfully limit the distribution 
of posts. 


Based on consultations with vaccination communication experts and other health partners, we 
worry that removing (as opposed to demoting) more expressions of vaccine hesitancy might be 
counterproductive to the goal of vaccine uptake, because it would: 1/ prevent hesitant people 
from talking through their concerns online and 2/ reinforce the notion that there's a cover-up (a 
key prong of anti-vaccine narratives). Details of feedback from external experts and research 
are below. 


We seek your guidance on how to treat this vaccine discouraging content. Here are the options: 
1. 25% demotion (current plan, execution under way) 
2. ~50% demotion, or even stronger (e.g., 80%) if we find that 50% isn't sufficient to keep 
such content out of top vaccine posts 
3. Remove this content 


We also continue to see pressure from partners and policymakers, including the White House, 
to remove entities that are seen to be contributing to a large amount of vaccine misinformation 
content (commonly referred to as the “disinformation dozen” which CCDH asserts are 
responsible for 73% of vaccine misinformation on Facebook). These “disinformation dozen” are 
linked to 34 accounts across Facebook and Instagram. We have reviewed these entities and 
determined that 6 accounts violate our policies and will be removed. We continue to review 
these entities on our platforms, but the remaining accounts do not currently violate our policies - 
including our Dedicated Vaccine Discouraging Entities (DVDE) policy. We believe that these 
entities understand our policy lines clearly and are careful not to post content that goes beyond 
these, but rather direct followers and group members to off platform entities where they share 
more overt vaccine misinformation. We also believe that some of the more high profile entities 
changed their behavior since our larger takedowns earlier this year, and have stopped posting 
vaccine misinformation (e.g., RFK’s Jr.'s Page). We continue to monitor these entities on 
platform, and are reviewing the off platform activities as well, but do not believe we currently 
have a clear path for removal of these. 


Details below. 


Thanks, 


A. Definitions of the Vaccine Discouraging Content in Question 


1. Sensational or Alarmist Vaccine Content: Content that otherwise does not violate our 
COVID-19 or vaccine policies above but that suggests that vaccines are unsafe, ineffective, 
sacrilegious or irrelevant, in exaggerated, conspiratorial, or sensational terms. This includes 
content that makes generalizations about vaccine harms or utility in hyperbolic terms or 
without providing context, or which connects vaccination to a conspiratorial narrative about a 
purposely hidden widespread health harm, secret, or truth. 
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a. Ex: “Vaccines are the work of the Devil” 
. Ex: “These VAXX are so bad for your body!” 
Ex: “I need to detox my kid to flush toxins out after his vaccines...Any ideas?” 

2. Chiticizing the Choice to Receive/Provide Vaccines: Content that otherwise does not violate 
our COVID-19 or vaccine policies above but that disparages others on the basis of their 
choice to get vaccinated, or on their choice to vaccinate others, including attacking language 
used towards vaccinated people or those administering vaccinations, or blaming people for 
misfortune after vaccination. 

a. Ex: “You're committing child abuse for giving this vaccine.” 

b. Ex: “Only someone clinically insane would get this vaccine!” 

c. Ex: “Any extreme pro-vaxers unfriend me. You are a danger to public health you 
thick, unscientific twats” 

d. Ex: "I can't believe they got vaccinated, what idiot sheeple” 

e. Ex: “Take a look around people -- anyone who gets these experimental vaccines is 
just a guinea pig.” 


B. Options for Addressing Severe Vaccine Discouraging Content 


1. 25% demotion — plan of record, still need to execute - consistent with the integrity Ranking 
Guidelines (IRGs), we can demote by 25%. We are just beginning to do this. 
a. Pros: slows distribution of such content; consistent with normal practice for demoting 
problematic content without specific user notice/appeals 
b. Cons: unsatisfactory to certain critics who want us to take even stronger action; 
some demoted content may still go viral 
2. ~50% demotion, or even stronger (e.g., 80%) if we find that 50% isn't sufficient to keep 
such content out of top vaccine posts 
a. Pros: may satisfy some critics who want more aggressive action; significantly 
reduces virality of vaccine discouraging content 
b. Cons: inconsistent with normal practice for demoting problematic content without 
specific user notice/appeals; could be seen as shadowbanning 
3. Remove 
a. Pros: may satisfy certain vocal critics; best option to reduce virality 
b. Cons: removes true content and personal opinions; reduces public conversation on 
important issue; provides “evidence” to people who believe FB is overly censorious 
or participating in vaccine cover-ups 


C. External Perspectives on Removing More Vax Hesitancy Content 


Since 2018, we have consulted extensively with external experts about our approach to vaccine 
content on Facebook and our engagement has stepped up significantly during the COVID 
pandemic. We have received varied responses on what the right approach is when it comes to 
removal and have modest confidence in our current approach. Some key health partners, 
including the WHO, continue to advocate for removing much more content. The WHO has 
communicated to us that they think our current policies are not comprehensive enough 
especially when it comes to takedowns of entities that they believe we should be removing due 
to the harmful impact they have on vaccine confidence (and, in turn, ending the pandemic). As 
mentioned above, the White House also continues to put significant pressure on removing 
more. 


However, many vaccine communication experts seem to think we are now in the right place in 
terms of policy-writing about what content we remove vs. reduce. Among these experts, there 
is a general sense that deleting more expressions of vaccine hesitancy might be 
counterproductive to the goal of vaccine uptake, because it would: 1/ prevent hesitant 
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people from talking through their concerns and 2/ reinforce the notion that there’s a 
cover-up (a key prong of anti-vax narratives). These risks seem particularly acute now in the 
US, because we are quickly approaching the point of supply exceeding demand and remaining 
hesitant people being able to seek answers to their questions and having their concerns 
addressed. There may be risk of pushing them further toward hesitancy by suppressing their 
speech and making them feel marginalized by large institutions. 


Prior external research on effective interventions to address vaccine hesitancy highlights the 
critical importance of facilitating open dialogue, especially dialogue that is or that can be tailored 
to the individual or their communities. Research suggests that attitude change happens when 
people get a chance for productive discourse and addressing people's concerns head on (rather 
than reducing chances for conversation) can lead to positive change. Opening up a chance for 
people to express their hesitancy, criticism and concerns can serve as an important way 
for them to access information. Moreover, past on-platform network research has 
suggested that there is likely to be a backlash from taking down conspiracy-oriented 
networks’ content, though in light of lessons learned we may be better equipped to handle it 
with our tools than we have previously. 


Consistent with this reasoning, in March, the Washington Post Editorial Board published a piece 
titled, “Banning vaccine-hesitant posts is not he way to ease people's fears” which made the 
case that removals (and broad, strong demotions) would be counterproductive: “sweeping 
takedowns or down-rankings of all borderline content could foster more misgiving, and 
deprive people of the opportunity to discuss and learn.” 


Vaccine Content Quality Integrity Framework" (from which we excerpted the definitions above), 


and we've since vetted this framework with outside experts. Of note, in early March, we 
discussed our planned approach with members of the “High Level Panel on Vaccine Confidence 
& Misinformation” (organized by London School of Hygiene and Tropical Medicine and the 
Center for Strategic and International Studies). Key take-aways: 

e The panel had very positive feedback for our framework, calling it “sophisticated 
and nuanced.” They appreciated that the B2V work addresses a critical gray zone of 
content that may contribute to vaccine hesitancy. 

« The Panelists highlighted the importance of avoiding unintended consequences 
that may be associated with squashing expression on the platform. 

e« Experts underscored that they would be very hesitant about removing content 
that leads users to discuss vaccines. They expressed concern around stifling healthy 
debate about the vaccines, especially with regard to the sharing of personal vaccine 
anecdotes or other vaccine discussion and debate. For example, some pointed to the 
importance of facilitating open conversation online between parents whose children 
experienced adverse effects from the COVID vaccine. 


While thinking through our policies, we also recently met with Heidi Larson, the head of the 
Vaccine Confidence Project. Heidi's general view is that we need to create an open and 
safe space for people to have vaccine-related conversations. She believes we need to hear 
about people's fears and anxieties related to the vaccine and respond appropriately (not just 
throw facts at people but understand there is an emotion behind people’s claims and questions). 
We met with Heidi again on 4/26 to check in on whether our approach to content expressing 
vaccine hesitancy was still in the right place. While acknowledging that it's a complicated time 
due to recent discouraging safety events, she continues to support not removing this 
content due to the aforementioned potential inadvertent effects of removing this kind of content 
and is happy to be a spokesperson for us. 


D. Content Examples 
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A. Content we REMOVE 
Violating Misinformation & Harm — REMOVE 


The Tribulation Series @ (by David Galvin @ ) 
Mar 17, 2021 12:55pm - @ 
801398530475219 @ 


Vaccination plan is the New World Order plan! MUST SEE 
VIDEO! Covid-19 Vaccines Are Weapons of Mass 
Destruction — and Could Wipe out the Human Race! 
https://theburningplatform.com/2021/03/16/covid-19- 
vaccines-are-weapons-of-mass-destruction-and-could- 
wipe-out-the-human-race/ #Trump #MAGA 
Translate 

THEGURNINGPLATFORM COM . 


Covid-19 Vaccines Are Weapons of Mass Destructi... 


Recommendations 


Original Recommendation - None 


Your Recommendation 


Misinfo Policy Review-Delete # Edit 
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The Tribulation Series @ (by David Galvin @ ) 
Mar 2, 2021 3:27pm @ 


792970307984768 @ 


Pfizer death vaccine IS A PROBLEM! Death Rates 
Skyrocket in israel Following Pfizer Experimental COVID 
“Vaccines”! https://tapnewswire.com/2021/03/death- 
rates-skyrocket-in-israel-following-pfizer-experimental- 
covid-vaccines/ #MAGA #Trump #News #Politics 


Transiate 


TAPREWSWIRE CO’ 


Death Rates Skyrocket in Israel Following Pfizer 
Experimental COVID “Vaccines” | 
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Lorie! Adams 
Feb 11,2021 8:41am: @ 
TOVIAS27FRGESSS7 49 | 


PANDEMIC CRITICALLY CONSIDERED If | get vaccinated... - Can | stop 
wearing the mask? - Government: No - Can the restaurants, pubs, bars, etc. 
reopen and everyone work normally? - Government: No - Am | resistant to 
covid? - Government: Maybe, but we don't know for sure.....- Atleast | am 
no longer contagious to others? - Government: No, you can still pass it on, 
possibly no one knows. - !f we vaccinate all children, will school go on as 
normal? - Government: No If | am vaccinated, can | stop social 
dissociation? - Government: No - if | am vaccinated, can | stop disinfecting 
my hands? - Government - No - If | vaccinate myself and my grandpa, can 
we hug? - Government: No - Will movie theaters, theaters and stadiums 
reopen thanks to vaccines? - Government: No ~ May the vaccinated be able 
to gather [events; parties}. - Government: No - What is the real benefit of 
vaccination? - Government: The virus will not kill you. - Are you sure it won't 
kiil me? - Government: No - if statistically the virus won't kill me anyway... 
Why should i get vaccinated?’ - Government: To protect others. - So if | get 
vaccinated, others are 100% sure | won't infect them? - Government: No, we 
are not sure, So, to summarize: The Covid 9 vaccine.... - Does not give 
immunity. - Does not eliminate the virus. - Does not prevent death. - Doesn't 
guarantee you won't get it. - Doesn't stop you from getting it. - Does not 
stop you from passing it on. - Doesn't preclude the need for travel bans. - 
Doesn't preclude the need for business closures; - Doesn't preclude the 
need for closures. - doesn't preclude the need for concealment, Grainiecres 
Translate 


Explicit Vaccine Discouragement — REwOVE 


Jeremiah Princely Jr. updated his status. 
Oy Om Gd Tih dim 


Only a mad person will take a Vaccine that will kili you when 
Corona virus did not. Don't take any vaccine 
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Sy One Bei Ph ater 


AFTER TAKING THE VACCINE « THEY SAY ITS SAFE BUT WE 
CAN SEE ITS NOT SAPE... 
JUST SAY NO #unapologetic 


SEES ERISES SS 
REAL TALK TRUTH SEASON... 


@ % required. 


WAKE UP... 


REMEMBER ITS YOUR CHOICE...... WE AINT MAD 


ENOUGH... 

GOVERNMENT AINTT MAD ENOUGH... 
HELP ME TO HELP US WITH THE. 

LAD - Making A Difference Campaign 


Content we REDUCE 


Sensational or Alarmist Vaccine Content -- REDUCE 
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ome, Shenae Socryhii 
ea Mar 21, 2621 10-Gaam 2 
EY PEESEORS ESSE S3603 


; asry Larudret 
Pa Mar 21, 2021 92Gam-@ 
729 P28797HK3GR1 


Ben Gilroy 


@BenGiroytt 


if there was a contraceptive 
vaccine, but after taking it you 
could still get pregnant @ .... 
and you still had to wear a 
condom,. Would you still take it? 
it really is that stupid @ 


377 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0058833 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


IMAGINE A | 
VACCINE SO SAFE YOU HAVE 


FOR i DISEASE SO DEADLY YOU 
HAVE TO BE TESTED TO 
KNOW YOU HAVE IT 
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CHIL DRENSHEALTMDEFENSE O8G 


. Mieve Sherlock » ABFE Level 1 Tate 
Mor 21,2021 S24pm 
{EOHS4ORGOSN TEST 


Hi a8 whats the Geet comtination far detoxing covid vaocine toxine ? 
Thinking dagger baker, pew pew. wild patate tush.? Thanks xx 
Prasat 


Os 


Anania Chvieting Kapert 

}SBSS7EOTI2G0RS 2 

Maeve lan referred to Emergency ad Purlfyitg as mentioned above 
He referred to other vaccines not the Mina. Of course i will hep 
Gail... 


Criticizing the Choice to Receive/Provide Vaccines — REDUCE 


And thei x axactty veity ¢ eit not grt ay vance’ «the seperts caer net 
aggret Gt what is effective nor has then: Dien any data/giudies Gone ts 
show ine fects. Evetyane 42 romtilng: atdeined Whe Jereninnige fmehirig 1 pterrty 
io Ubi deaths Hite Te $43 to gel a viectine fet muy cr may nat be 
treipful - and the meds Is keeping the panic gong 


SESH 


Some medical experts say one-shot regimen for Pfizer, Modema 
COVID-19 vaccines not enough 
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g John Hotman 
Mer 23, 242% Pi Tom 


(earned tas new words today aeacee 


Tranqite 
Album contaiming 2 iternis) 
FAUCESM oocenos 


vaxhole 


ed Vt Satter Fit went tected Re Se ERDAS 
ARO, abo f Reps 


SER eneohsie eee tine nenenachd met mene Ret shone a 
Pek Tiey estes depos OLA Dot 


By PY Coat Feemgary os, Pend 


i ii sace aed | 1 Pas 


Nicene” 


Kathy Hughes shared a link, 
Gy Om td 13h 36s 


Exactly why | am NOT getting any of these vaccines. Anyone who 
gets one right now is simply signing up for a clinical trial. You are 
essentially allowing yourself to be a quinea pig. 


& External Link 


§9NEME COC. FDA Urge ‘Pause’ in Johnson & Johnson 
imme Vaccine - Videos from The Weather Channel | 
ee ~weather.com 


Six women developed potentially dangerous blood 
clots in the days after receiving the Johnson & 
Johnson COVID-19 vaccine. The CDC and FDA are 
investigating. - Videos from The Weather Channel | 
weather.com 
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META-118HJC-0058836 


Facebook User 


Gy Gm Sd 18h Barn 


Weil we'll well what do all you vaccine/masker nazis have to 
say about us anti vaxers now Huh its not funny really but how 
the heck can millions of people just jump into an experiment. 
fsheep 


Ere eR EER 
URGENT 


Drew Nutt updated his status. 


Oy Om 2d 17h 3hm 


i now feel sorry for all of you who were vaccinated, since the 
FDA and CDC are withdrawing the Johnson vaccine due to 
blocd clots... you now see why we chose not to be test 
dummys.. best of luck lab rats 


Deena Lynn shared a post. 


+ Om SG 18h 54m 


Sharing |S caring.... everytime | see your vaccine cards proudly 
posted, | pray for your children. Stop being utter fools!! 


From: EO fb.com> 
Date: Tuesday, April 27, 2021 at 4:04 PM 


fb.com 


Ew 


Subject: Re: Vaccine Policy 
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From: fb.com> 
Date: Tuesday, April 27, 2021 at 3:01 PM 


To: fb.com>, fb.com>, EE fb.com>, 
RD b.com>, fb.com>, RE b.com>, 
G2 fb.com> 


Cc: EE © 1>.:on>, ES §.com>, 


ee fb.com>, in fb.com>, ay 
fb.com>, fb.com> 


Subject: Re: Vaccine Policy 


Thx for this. A few quick Qs from me before this is finalized: 


e |think we should rehearse with Mark our stance on the “12 accounts generate the majority of vaccine misinfo” 
assertion, not least since it has been made available to the team at the WH again recently by a group of misinfo 
researchers. 

e =| find that the below somewhat conflates two things: a) the advice from vaccine comms experts re the 
“importance of facilitating open dialogue”; and b) the virality/prominence of vaccine discouraging content (as 
per post #3). It stretches credulity, to me at least, that that post is an important facilitator of “open dialogue”. 
It’s basically satirical, after all. In other words, | think it’s perfectly logical to say that FB should play a role in 
allowing people to express their doubts, share misgivings, enter into informed dialogue etc whilst at the same 
time wishing to see FB bear down (through aggressive demotion or removal) on the wide/viral circulation of 
material that might encourage and legitimize vaccine hesitancy. To our WH interlocutors, at least, the 
suggestion that a viral Leonardo di Caprio vaccine hesitant meme is part and parcel of productive “open 
dialogue” will, not unreasonably, be viewed with considerable skepticism. So if we are going to defend that 
stance, |’d do it on different grounds (satire, open speech etc). 

e Why do we believe that our judgement of the balance between removal and visibility etc is better than the 
WHO’s? Whilst I’m sure our consultations have been thorough, we shouldn’t lose sight of the fact that the WHO 
— despite its numerous flaws — is going to be a considerably more credible voice on these judgements than a 
social media company. At a minimum, we should explain how we would argue our case as/when WHO health 
professionals — and others — step up their criticisms of our approach. 

Thx 
N 


From: Eo fb.com> 


Date: Tuesday, April 27, 2021 at 12:00 PM 


To: fb.com>, 2 fb.com>, fb.com>, 
? {b.com>, fb.com>, fb.com>, iii 
EEO f5.com> 


ce fb.com>, fb.com>, 
fb.com>, fb.com>, fb.com>, i 


M2 fb .com> 


Subject: Re: Vaccine Policy 


Please see a draft note for Mark and Sheryl with 3 stronger enforcement options against vaccine discouraging content 
here (and copied below as well) further to the discussion with Mark last week. Let us know if any feedback or if there’s 


anything missing here. 
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Thanks so much, 


Subject: [For Decision] Vaccine discouraging content 
Mark, Sheryl: 
We are seeking your guidance on whether to take more aggressive action against certain vaccine discouraging content. 


We are facing continued pressure from external stakeholders, including the White House and the press, to remove more 
COVID-19 vaccine discouraging content. For example, we recently shared with the White House a list of the top 100 
vaccine-related posts on FB in the U.S. for the week of 4/5-4/11. While authoritative information dominated the list, the 
White House was concerned that the #3 post was a vaccine discouraging humorous meme, and they called on us to 
delete the meme. 


We currently remove content that includes certain misinformation about covid and vaccinations (e.g., the covid vaccine 
has microchips) and content that explicitly discourages vaccination (e.g., the COVID-19 vaccine is too dangerous - don’t 
get it!). Under our policies, this meme should not be removed. 


Instead, we aim to reduce this sort of vaccine discouraging content, namely ‘sensational or alarmist content’ (e.g., 
there’s no point vaccines are useless!; vaccines are the work of the devil; these Vaxx are so bad for your body!) and 
‘criticism of personal vaccine choices’ (e.g., it’s child abuse to give your kid the vaccine; you'd have to be a complete 
moron to get vaccinated). 


To reduce this content, we are currently building systems to review & demote on escalation, and over time hope to have 
demotions at scale through classifiers (although that kind of scaled enforcement is likely to be challenging). We are not 
convinced we'll be able to catch all kinds of this content quickly enough before it gains some distribution. Additionally, 
given people's interest in the topic, weaker demotions may not be sufficient to meaningfully limit the distribution of 


posts. 


Based on consultations with vaccination communication experts and other health partners, we worry that removing (as 
opposed to demoting) more expressions of vaccine hesitancy might be counterproductive to the goal of vaccine uptake, 
because it would: 1/ prevent hesitant people from talking through their concerns online and 2/ reinforce the notion that 
there’s a cover-up (a key prong of anti-vaccine narratives). Details of feedback from external experts and research are 
below. 


We seek your guidance on how to treat this vaccine discouraging content. Here are the options: 
1. 25% demotion (current plan, execution under way) 
2, ~50% demotion, or even stronger (e.g., 80%) if we find that 50% isn’t sufficient to keep such content out of top 
vaccine posts 
3. Remove this content 


Details below. 


Thanks, 


A. Definitions of the Vaccine Discouraging Content in Question 


1. Sensational or Alarmist Vaccine Content: Content that otherwise does not violate our COVID-19 or vaccine 
policies above but that suggests that vaccines are unsafe, ineffective, sacrilegious or irrelevant, in exaggerated, 
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conspiratorial, or sensational terms. This includes content that makes generalizations about vaccine harms or 
utility in hyperbolic terms or without providing context, or which connects vaccination to a conspiratorial 
narrative about a purposely hidden widespread health harm, secret, or truth. 
a. Ex: “They’re coming with these dangerous shots for you next -- the sheep of the world need to wake 
up.” 
b. Ex: “Vaccines are the work of the Devil” 

Ex: “These VAXX are so bad for your body!” 

Ex: “Vaccines are so useless, what’s the point!” 

Ex: “I need to detox my kid to get these vaccine toxins out...Any ideas?” 

2) Oise the Choice to Receive/Provide Vaccines: Content that otherwise does not violate our COVID-19 or 
vaccine policies above but that disparages others on the basis of their choice to get vaccinated, or on their 
choice to vaccinate others, including attacking language used towards vaccinated people or those administering 
vaccinations, or blaming people for misfortune after vaccination. 

a. Ex: “You're committing child abuse for giving this vaccine.” 

b. Ex: “Only someone clinically insane would get this vaccine!” 

c. Ex: “Any extreme pro-vaxers unfriend me. You are a danger to public health you thick, unscientific 
twats” 

d. Ex: “I can’t believe they got vaccinated, what idiot sheeple" 

e. Ex: “Take a look around people -- anyone who gets these experimental vaccines is just a guinea pig.” 


ao 


B. Options for Addressing Severe Vaccine Discouraging Content 


1. 25% demotion < plan of record, still need to execute - consistent with the Integrity Ranking Guidelines (IRGs), 
we can demote by 25%. We are just beginning to do this. 
a. Pros: slows distribution of such content; consistent with normal practice for demoting problematic 
content without specific user notice/appeals 
b. Cons: unsatisfactory to certain critics who want us to take even stronger action; some demoted content 
may still go viral 
2. ™50% demotion, or even stronger (e.g., 80%) if we find that 50% isn't sufficient to keep such content out of top 
vaccine posts 
a. Pros: may satisfy some critics who want more aggressive action; significantly reduces virality of vaccine 
discouraging content 
b. Cons: inconsistent with normal practice for demoting problematic content without specific user 
notice/appeals; could be seen as shadowbanning 
3. Remove 
a. Pros: may satisfy certain vocal critics; best option to reduce virality 
b. Cons: removes true content and personal opinions; reduces public conversation on important issue; 
provides “evidence” to people who believe FB is overly censorious or participating in vaccine cover-ups 


C. External Perspectives on Removing More Vax Hesitancy Content 


Since 2018, we have consulted extensively with external experts about our approach to vaccine content on Facebook 
and our engagement has stepped up significantly during the COVID pandemic. We have received varied responses on 
what the right approach is when it comes to removal and have modest confidence in our current approach. Some key 
health partners, including the WHO, continue to advocate for removing much more content. The WHO has 
communicated to us that they think our current policies are not comprehensive enough especially when it comes to 
takedowns of entities that they believe we should be removing due to the harmful impact they have on vaccine 
confidence (and, in turn, ending the pandemic). As mentioned above, the White House also continues to put significant 
pressure on removing more. 


However, many vaccine communication experts seem to think we are now in the right place in terms of policy-writing 
about what content we remove vs. reduce. Among these experts, there is a general sense that deleting more 
expressions of vaccine hesitancy might be counterproductive to the goal of vaccine uptake, because it would: 1/ 
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prevent hesitant people from talking through their concerns and 2/ reinforce the notion that there’s a cover-up (a key 
prong of anti-vax narratives). These risks seem particularly acute now in the US, because we are quickly approaching 
have voiced the value in hesitant people being able to seek answers to. their questions and having their concerns 
addressed. There may be risk of pushing them further toward hesitancy by suppressing their speech and making them 
feel marginalized by large institutions. 


Prior external research on effective interventions to address vaccine hesitancy highlights the critical importance of 
facilitating open dialogue, especially dialogue that is or that can be tailored to the individual or their communities. 
Research suggests that attitude change happens when people get a chance for productive discourse and addressing 
people’s concerns head on (rather than reducing chances for conversation) can lead to positive change. Opening up a 
chance for people to express their hesitancy, criticism and concerns can serve as an important way for them to access 
information, Moreover, past on-platform network research has suggested that there is likely to be a backlash from 
taking down conspiracy-oriented networks’ content, though in light of lessons learned we may be better equipped to 
handle it with our tools than we have previously. 


Consistent with this reasoning, in March, the Washington Post Editorial Board published a piece titled, “Banning vaccine- 
hesitant posts is not the way to ease people’s fears” which made the case that removals (and broad, strong demotions) 
would be counterproductive: “sweeping takedowns or down-rankings of all borderline content could foster more 
misgiving, and deprive people of the opportunity to discuss and learn.” 


Our conversations with experts informed the creation of the “Barriers to Vaccination (B2V): Vaccine Content Quality 
integrity Framework” (from which we excerpted the definitions above), and we've since vetted this framework with 


outside experts. Of note, in early March, we discussed our planned approach with members of the “High Level Panel on 
Vaccine Confidence & Misinformation” (organized by London School of Hygiene and Tropical Medicine and the Center 
for Strategic and International Studies). Key take-aways: 

e The panel had very positive feedback for our framework, calling it “sophisticated and nuanced.” They 
appreciated that the B2V work addresses a critical gray zone of content that may contribute to vaccine 
hesitancy. 

e The Panelists highlighted the importance of avoiding unintended consequences that may be associated with 
squashing expression on the platform. 

« Experts underscored that they would be very hesitant about removing content that leads users to discuss 
vaccines. They expressed concern around stifling healthy debate about the vaccines, especially with regard to 
the sharing of personal vaccine anecdotes or other vaccine discussion and debate. For example, some pointed to 
the importance of facilitating open conversation online between parents whose children experienced adverse 
effects from the COVID vaccine. 


While thinking through our policies, we also recently met with Heidi Larson, the head of the Vaccine Confidence 
Project. Heidi’s general view is that we need to create an open and safe space for people to have vaccine-related 
conversations. She believes we need to hear about people’s fears and anxieties related to the vaccine and respond 
appropriately (not just throw facts at people but understand there is an emotion behind people’s claims and questions). 
We met with Heidi again on 4/26 to check in on whether our approach to content expressing vaccine hesitancy was still 
in the right place. While acknowledging that it's a complicated time due to recent discouraging safety events, she 
continues to support not removing this content due to the aforementioned potential inadvertent effects of removing 
this kind of content and is happy to be a spokesperson for us. 


D. Content Examples 


A. Content we REMOVE 


Violating Misinformation & Harm € REMOVE 
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| The Tribulation Series @ (by David Galvin @ ) 
Mar 17, 2021 12:55pm - @ 
801398580475219 @ 


Vaccination plan is the New World Order plan! MUST SEE 
VIDEO! Covid-19 Vaccines Are Weapons of Mass 
Destruction — and Could Wipe out the Human Race! 
https://theburningplatform.com/2021/03/16/covid-19- 
vaccines-are-weapons-of-mass-destruction-and-could- 
wipe-out-the-human-race/ #Trump #MAGA 


Translate 
THEBURNINGPLATFORM COM : 
Covid-19 Vaccines Are Weapons of Mass Destructi... 


Recommendations 


Original Recommendation - None 


Your Recommendation 


Misinfo Policy Review-Delete 4° Edit 
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The Tribulation Series @ (by David Galvin @ ) 
Mar 2, 2021 3:27pm: @ 
PO297 A807 984708 @ 


Pfizer death vaccine 1S A PROBLEM! Death Rates 
Skyrocket in israel Following Pfizer Experimental COVID 
“Vaccines”! https://tapnewswire.com/2021/03/death- 
rates-skyrocket-in-israel-following-pfizer-experimental- 
covid-vaccines/ #MAGA #Trump #News #Politics 


Transiate 


TAPNEWGWIRE COM 


Death Rates Skyrocket in Israel Following Pfizer 
Experimental COVID “Vaccines” | 
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Loriel Adams 
Feb 11,2021 8:41am: @ 
1O21A4927kO8888749 @ 


PANDEMIC CRITICALLY CONSIDERED If | get vaccinated....- Can! stop 
wearing the mask? - Government: No - Can the restaurants, pubs, bars, etc. 
reopen and everyone work normally? - Government: No - Am | resistant to 
covid? - Government: Maybe, but we don't Know for sure.....- Atleast | am 
no longer contagious to others? - Government: No, you can still pass it on, 
possibly no one knows, - If we vaccinate all children, will school go on as 
normal? - Government: No - if | am vaccinated, can | stop social 
dissociation? - Government: No - if | am vaccinated, can | stop disinfecting 
my hands? - Government - No - if | vaccinate myself and my grandpa, can 
we hug? - Government: No « Will movie theaters, theaters and stadiums 
reopen thanks to vaccines? - Government: No - May the vaccinated be able 
to gather (events; parties}. - Government: No - What is the real benefit of 
vaccination? - Government: The virus will not kili you. - Are you sure it won't 
kill me? « Government: No - |f statistically the virus won't kill me anyway... 
Why should | get vaccinated?" - Government: To protect others. - So if | get 
vaccinated, others are 100% sure | won't infect them? - Government No, we 
are not sure, So, to summarize: The Covid 9 vaccine..., - Does not give 
immunity. - Does not eliminate the virus, - Does not prevent death. - Doesn't 
guarantee you won't get it. - Doesn't stop you from getting it. - Does not 
stop you from passing it on. - Doesn't preclude the need for trave! bans. - 
Doesn't preciude the need for business closures, - Doesn't preclude the 
need for closures, - doesn't preclude the need for concealment. Grants 
GRAS 

Transiate 


Explicit Vaccine Discouragement € REMOVE 


Jeremiah Princely Jr. updated his status. 
Oy Grn Bd Tih 4im 


Only a mad person will take a Vaccine that will kill you when 
Corona virus did not. Don't take any vaccine 
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Perebook Umer - Yerifed 
Sy Gee Bei Ph Ales 


AFTER TAKING THE VACCINE » THEY SAY ITS SAFE BUT WE 
CAN SEE ITS NOT SAFE... 
JUST SAY NO #unapologetic 


PRR SSLLLILSS 


@ 3 required. 


WAKE UP... 


MAD-Make A Difierence 
DONATE OR JOIN THE VILLAGE 


REMEMBER ITS YOUR CHOICE... WE AINT MAD 
GOVERNMENT AINTT M_A.D ENOUGH... 

HELP ME TO HELP US WITH THE. 

MAO - Making A Diference Campaign 


Content we REDUCE 


Sensational or Alarmist Vaccine Content + REDUCE 
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oy, Sonn Berri 
e Mar 27, 2621 10:G4arn » 
Er - POESHOHES SSB SESS 


‘ asry Laradreth: 
am haar 21, 2021 920an @ 


b 27g P28TerDAge Zt 


Ben Gilroy 
@RenGiroyti 


if there was a contraceptive 
vaccine, but after taking it you 
could still get pregnant @ .... 
and you still had to wear a 
condom,. Would you still take it? 
it really is that stupid @ @& 
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cou, Maeve Sherlock » ABPE Level 1 Tate 
‘Mer 21,2921 S24om 
" ASGRZAEBEOSE TEST 
+i all vasate the best combination for datoxing covic vaocina taxing ? 
Thinking dagger hakea, paw paw, wild potas tah. ? Thanks xx 


Tramtiate 


Os 
Apanida Chistine Kapent 


TRIGSIGOZ720RES 4 
Maeve lun referred to Emergency and Purllying as mentioned above. 
Me seferred to other vaccines nat the Mina Of course it wil help 


oat... 


Criticizing the Choice to Receive/Provide Vaccines < REDUCE 
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Deena Lynn shared a post. 


» Swan Red 2 . 
¥ Om Sa tah S4m 


Sharing |S caring.... everytime | see your vaccine cards proudly 
posted, | pray for your children. Stop being utter foois!! 


From: @fb.com> 
Date: Wednesday, April 21, 2021 at 5:30 PM 
To: 


fb.com>, fb.com> 
fb.com>, ; ‘ 


fb.com> 
Subject: Re: Vaccine Policy 


Re comments / Qs: 


e “should we schedule a follow-up meeting to discuss these options and make a decision? Or would you propose 
that we wait until the B2V classifer is running and see how the 25% demotion is performing?” 


393 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0058849 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


o My view is that we should focus on executing Option 1 (status quo, 25%). It seems likely that better 
demotion coverage, rather than higher strength, will work here. BF ould keep me honest, but | 
believe that we have only manually demoted a single piece of content for being Tier 1 B2V so far (and it 
wasn’t the DiCaprio meme). There’s active work to scale this up — both manually and to build 
classifiers. If we find that 25% strength (with good coverage) isn’t working to keep B2V content out of 
the Top N, then we can turn up to 50% (but I’d still argue for giving notice, because | don’t like taking 
such strong action without any transparency or accountability). 

e “| don’t see any reason not to reach out to Heidi Larson and other panel members to understand whether they 
would be willing to speak out more publicly and/or privately with the White House” 

o We'll reach out to Heidi and others to get of sense of their comfort speaking w/ or being mentioned to 
the WH. 

e “What is Nick able to share about this work with Andy Slavitt without reaching out to the panel members? Can 
identify institutions/participants? Can he say that that we received this feedback from the “High Level Panel on 
Vaccine Confidence & Misinformation” organized by the London School of Hygiene and Tropical Medicine and the 
Center for Strategic and International Studies?” 

fe) a est briefed a few of us on his convo today with Rob at the WH. Gould keep me honest, 
but it sounds like (surprisingly) Rob generally agreed with our reduce & inform approach here. He 
shared the concern removing too much content would be counterproductive b/c it would 1/ prevent 
hesitant people from talking through their concerns and 2/ reinforce the notion that there’s a cover-up 
(a key prong of anti-vax narratives). Brian said that we’ve discussed this with independent experts, but 
did not name names or affiliations. | think Nick should do the same in his next call with Andy (unless we 
hear back from some of these experts in time and they want to be referenced). 


(ror I Focom> 
Date: Wednesday, April 21, 2021 at 5:03 PM 
To: 


EEO com> 


Subject: RE: Vaccine Policy 


Yes, here’s the YouTube 


comparison: https://docs.google.com/document/d/imFN5s0huw9qX8iY2xwjYO8Vwt4tigAGAS- 
QQcmTinQc/edit ?usp=sharing 


From: SE © com> 
Sent: Wednesday, April 21, 2021 3:57 PM 


To: or ET >; I con 
fb.com>; 
B01. com>; IO fb.com> 


Subject: Re: Vaccine Policy 


Thanks — should we schedule a follow-up meeting to discuss these options and make a decision? Or would you propose 
that we wait until the B2V classifer is running and see how the 25% demotion is performing? Personally going to 50% 


without specific notice seems pretty no-regrets to me (though obviously we'll have issues if the classifier precision isn’t 
great). 


| don’t see any reason not to reach out to Heidi Larson and other panel members to understand whether they would be 
willing to speak out more publicly and/or privately with the White House — think we should just do that. What is Nick 
able to share about this work with Andy Slavitt without reaching out to the panel members? Can identify 
institutions/participants? Can he say that that we received this feedback from the “High Level Panel on Vaccine 
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Confidence & Misinformation” organized by the London School of Hygiene and Tropical Medicine and the Center for 
Strategic and International Studies? 


@Nell McCarthy, are you working on the YouTube comparison — let me know if | can help. That seems like the other 
urgent thing to make sure that Nick feels prepared to talk to Andy. 


From: fb.com> 
Date: Wednesday, April 21, 2021 at 3:33 PM 


Subject: Re: Vaccine Policy 


Thanks ll We prepared this doc (also attached) to address action items #1, #2, and #3 below. Here’s the TL;DR: 

1. We do not currently automatically demote vaccine discouraging / barrier to vaccination content at scale 
(although we are working on classifiers to do so). 

2. Last week, for the first time, we started to demote by 25% the most severe, nonviolating vaccine discouraging 
content (“Sensational or Alarmist Vaccine Content” and “Criticizing the Choice to Receive/Provide Vaccines”) on 
escalation only. Since this approach is new, we do not know if this will keep such content out of the Top N 
vaccine content. 

3. While we are facing pressure to remove more content from certain external stakeholders, the general (not at all 
unanimous) view of vaccine communication experts is that us removing more expressions of vaccine hesitancy 
might be counterproductive to the goal of vaccine uptake, because it would: 1/ prevent hesitant people from 
talking through their concerns and 2/ reinforce the notion that there’s a cover-up (a key prong of anti-vax 
narratives). 

4. This doc presents four options for addressing Tier 1 vax-discouraging / “barriers to vaccination” (B2V) content: 


i. Maintain the status quo / 25% demotion 

il. 50% demotion + give user specific notice when we demote 
lil. 50% demotion, no specific user notice (general notice via Help Center) 
iv. Remove this content 


Date: Wednesday, April 21, 2021 at 2:36 PM 


Subject: Vaccine Policy 


Just realized that | hadn’t sent notes/next steps. Apologies if I’ve missed follow-up on any of these. | think the most 
urgent things for Nick’s next conversation with Andy Slavitt are #1, #3, and #5. It hasn’t been scheduled yet but would be 
good to know ETA on these items. 


1 Di. frame proposal for stronger demotions for a broader range of B2V content. | think this is pretty 
urgent — do we have an update on going to 50% and potentially going beyond T1? 
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a. describe policy that would result in removal of much more content. Based on most recent 
interactions with White House, | think this feels slightly lower priority but still worthwhile. 


3: io nee ae provide context about guidance we’ve received from health experts (with information about who 
those experts are) to reduce/inform rather than remove. Do we have update? 


4. Exploring introducing more friction in connection with inform/reduce. | think we are also looking at 
whether we can supplement our current inform approach with content specifically designed to reach vaccine-hesitant 
communities. Any updates here? 


,0UC to provide comparison of our policies and YouTube’s policies. 


From: G2 fb.com 

When: 2:00 PM - 2:30 PM April 19, 2021 
Subject: Vaccine Policy 

Location: 


se Zoom ak 
Meeting ID: 
Passcode: 


One tap mobile 
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Exhibit 37 


Internal Facebook email 
correspondence 


397 


From: </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)}/CN=RECIPIENTS/CN=6C40FEB25BD1 4F509B7E549D8CC6A528- 
> 
ce: Se 
Sent: 6/6/2021 11:29:48 AM 
Subject: Re: Covid misinformation: Wuhan lab leak theory 


Thanks lll And we have a note ready to send to leadership recommending reverting removals of the RFHs - 
we Just need to confirm one more thing. We will send it to you tomorrow for review. 


Sent from my iPhone 


On Jun 6, 2021, at 11:39 PM, i tp com> wrote: 


Please don’t share this email further but feel very comfortable referencing this message (and that BB szic it) if 
internal teams are pressuring us going forward 


From: Mark Zuckerber gilli fb.com> 
Sent: Sunday, June 6, 2021 10:31 AM 
To: 


ss oo 
Ce: Nick Clegg; Joe! Kap!ar; i 


Subject: Re: Covid misinformation: Wuhen lab leak theory 


Thanks for the context. This seems like a good reminder that when we compromise our standards due to pressure 
from an administration in either direction, we'll often regret it later. 


From: EES fb.com> 


Sent: Friday, June 4, 2021 2:24:20 PM 


To: Mark Zuckerberg fb.com> 
Cc: Nick Cle tb.com>; Joel Kaplan IEEE 'b.com>; Ms to.com> 


@fb.com>; Dib.com>: fb.com> 
Subject: Covid misinformation: Wuhan lab leak theory 


Mark: 


On the question of our decision to remove claims related to the origin of COVID -- In May 2020, we decided to 
leverage existing work from 3PFCs (because they were overwhelmed by Covid misinfo) by FB claim-matching for 
claims that multiple 3PFCs had labeled as false instead of requiring the 3PFCs to find and manually add their 
fact-checks to any content making the claims. There were five claims that met the standard, including the claim 
that Covid is “man-made, manufactured, bioengineered, a bioweapon, or created by an individual government or 
country,” which includes claims that the virus was modified through gain of function research and leaked from a 
lab. Between May 2020 and February 2021, we reduced distribution for content making the five claims, applied a 
label, and inked to the debunking article. 


In February 2021, in response to continued public pressure and tense conversations with the new Administration, 
we started removing the five Covid claims that had been repeatedly debunked by 3P FCs and the eight claims that 
we had identified {in partnership with WHO, CDC, and other public health authorities) before Covid as widely 
depunked vaccine misinformation. You asked us at the time to review the decision later in the year to determine if 
we should revert to reduce & inform. 
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Last month, two of the 3PFCs that rated the “man-made” claim as false changed their fact-checks. Politifact 
publicly rescinded its original fact-check. Factcheck.org updated its fact-check to acknowledge uncertainty. As this 
claim was no longer had multiple false fact-checks, we removed it from our list of claims that we were removing. 


While we believe we made appropriate decisions based on the information we had at the time, we also think this is 
ultimately a bad outcome, so we are working to revert all repeatedly fact-checked claims from a “remove” penalty 
to a “reduce & inform” penalty. 


There are additional details on the repeatedly fact-checked claims and a timeline below. Let us know if you'd like 
additional information, we also have time with you next week to discuss the path forward for our misinformation 
system. 


Repeatedly Fact-Checked Claims 


Claims that the new coronavirus/SARS-CoV-2/COVID-19: 


1. is mar-made, including any of the following: 
a. Claims that it was manufactured / bioengineered 
b. Claims that it is a bioweapon 
c. Claims that it was created by an individual, government, or country 
d. excluding: claims that it was studied in/came from/leaked from a lab without specifically calling it 
mar-made. 
2. is or has been patented, including: 
a. by any specific person or entity. 
3. was predicted, specifically: 
a. In “Event 201”’s pandemic exercise in October 2019 OR 
b. in “Event 201”’s pandemic simulation in October 2019 
c. excluding: discussing the October 2019 exercise/simulation without explicitly claiming it predicted the 
new coronavirus outbreak; claims about other possible predictions 
4. is not new, specifically: 
a. as proven by the existence of animal vaccines for coronavirus OR 
b. as proven by disinfectant product labels 


Claims about the role of masks in preventing the spread of COVID-19: 
5. Health authorities like the WHO/CDC do not recommend that healthy people wear masks. 


“Covid is man-made” claim timeline 


January 2020: Speculation begins as early as January 2020 that Covid could have leaked from a Wuhan lab. 
However, health experts largely rejected the possibility that COVID-19 was man-made or bioengineered, given 
the close genetic resemblance to bat coronaviruses, similar experience with other pathogens, and the absence of 
other countervailing evidence. {See detailed Washington Post timeline for more. } 


e January 30, 2020: First Newsroom Post where we announce we are starting “to remove content with false 
claims or conspiracy theories that have been flagged by leading global health organizations and local health 
authorities that could cause harm to people who believe them.” 


Spring 2020: Claims about the virus being man-made begin circulating on Facebook, and several U.S. 3PFCs rate 
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content making these claims as False. 


e March 25, 2020: Nick Clegg’s NRF where he states, on origin claims: “For claims that don't directly result in 
physical harm, like conspiracy theories ebout the origin of the virus, we continue to work with our network of 
over 55 fact-checking partners covering over 45 languages to debunk these claims.” 

¢ April 16, 2020 a < NRP announcing Correct the Record and adding COVID-19 fact checks to the 
COVID-19 Info Hub 


May 2020: Facebook starts labeling and demoting claims Covid is “man-made, manufactured, bioengineered, a 
bioweapon. or created by an tndividual, government or country.” but excluded claims that tt was “studied 
in/came from/leaked from a lab without specifically callmg it man-made,” given the possibility that 1t had 
accidentally leaked from the Wuhan lab had been less clearly debunked. This was in addition to starting to label 
and demote several other “repeatedly fact-checked hoaxes” (RFH) about Covid that were unlikely to change or 
become true (detail below). We did this as a way to slow the spread of the most common COVID-19 related 
hoaxes by reducing distribution and applymg warning labels on posts that repeat claims several fact-checkers 
have already debunked. This allowed fact-checkers to focus their ttme and journalistic expertise debunking net 
new claims. 


February 2021: As part of an overall effort to remove as much COVID-19 and vaccine-related misinformation 
from our platform as possible, we decided to remove COVID RFHs and Vaccine WDHs. 


* February 8, 2021: J NRP announcing this expansion: “Today, we are expanding our efforts to 
remove false claims on Facebook and Instagram about COVID-19, COVID-19 vaccines and vaccines In 
general during the pandemic. Since December, we've removed false claims about COVID-19 vaccines that 
have been debunked by public health experts. Today, following consultations with leading health 
organizations, including the World Health Organization (VWWHO)}), we are expanding the list of false claims we 
will remove to include additional debunked claims about the coronavirus and vaccines. This includes claims 
such as: 

o COVID-19 is man-made or manufactured 

o Vaccines are not effective at preventing the disease they are meant to protect against 

o It's safer to get the disease than to get the vaccine 

o Vaccines are toxic, dangerous or cause autism. 
“These new policies will help us continue to take aggressive action against misinformation about COVID-19 
and vaccines” 


May 2021: We stopped taking any FB enforcement action on the claim Covid 1s man-made ytven the renewed 
debate on the topic, indicating the issue is no longer settled. Two of our 3PFCs (Politifact and FactCheck.ory) had 
amended their False rating of claim, though fact-checkers retain discretion to rate specific content making this 
claim. (We've seen at least one example of a 3PFC changing their rating on specific content from False to 
Missing Context. } 


e May 26, 2021: NRP deprecating the COVID Is man made claim “In light of ongoing investigations into the 
origin of COVID-19 and in consultation with public health experts, we will no longer remove the claim that 
COVID-19 is man-made or manufactured from our apps. We're continuing to work with health experis to 
keep pace with the evolving nature of the pandemic and regularly update our policies as new facts and 
trends emerge.” 


June 2021 TBD: Misinto Policy to tee up recommendation to revert to reduce + label enforcement for Covid 
RFH clams, consistent with our codified principles for removing the most severely harmful misinformation vs, 
reducing + labeling other misinformation 
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Exhibit 38 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy 


Message 


From: @ib.com] 
Sent: 6/27/2021 8:03:56 PM 
To: MAwho.eop.gov 


Subject: FW: Facebook Covid report 
Attachments: 6 25 - COVID-19 Insights.pdf 


Hey—apologies for delay in my sending this over to you—missed it late Friday from Nick. Let me know if you want to 
connect on anything. 


From: Nick Clegg <{@fb.com> 
Date: Friday, June 25, 2021 at 6:19 PM 
To: Murthy, Vivek (HHS/OASH) < 
Ce: Slavitt, Andrew M. EOP/WHO < 
Subject: Facebook Covid report 


hhs.gov> 


Dear Vivek, 


Attached is the latest Covid report covering the past two weeks. As always, happy io answer any quesiions you 
might have with respect io the report’s contents. 


Additionally, | want to highlight two vaccine-related efforts ihat launched this week: 
The first is the WhatsApp chat bot we launched with the CDC. This Spanish-language bot not only surfaces local 


vaccine appointments, it also links users with free Uber/Lyft rides to their appointments and childcare availability 
nearby. We're excited by the impact this will have on the Latinx vaccination rate. 


Second, | wanted to share that we launched a notification to every Instagram user in the United States encouraging 
them to visit vaccines.gov. After months of state-specific notifications to |G’s +150M users in the US, this is 
Instagram’s first push to vaccines.gov. Based on the demographics of Instagram, we’re looking forward to reaching 
the nation’s youth and to having a positive impact on their vaccination rates. 


Thanks and please don’t hesitate to reach out. 
Best 


Nick 
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Exhibit 39 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy 


403 


From: GE «0-1 HEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
= OBB487E8111461E3692A624> 

To: who.eop.gov 

Sent: 7/11/2021 8:27:19 PM 

Subject: FW: Facebook Covid report 

Attachments: 7_8- COVID-19 Insights. pdf 


Making sure you received—hope all is well. 


From: Nick Clegg <—of com> 
Date: Saturday, July 10, 2021 at 8:00 AM 
To: Murthy, Vivek (HHS/OASH) <{iiO hhs. gov> 


Ce: Slavitt, Andrew M. EOP/WHO <iEEEO who.cop.gov>, tb. com> 


Subject: Re: Facebook Covid report 
Dear Vivek 


Attached is the latest Covid report covering the most recent two week period for which we nave stats etc. | 
understand from Brian that my team is meeting with yours next week to delve deeper into our covid misinformation 
efforts. As always, please don't hesitate to reach out whervif needed. ~ 


All best 


Nick 


From: Nick Clegg <l@fb.com> 


Date: Friday, June 25, 2021 at 11:19 PM 
To: "Murthy, Vivek (HHS/OASH)" < 
Ce: "Slavitt, Andrew M. EOP/WHO" 

fb.com> ‘ 
Subject: Facebook Covidreport 


hhs.gov> 


who.cop.cov>, I 


Dear Vivek. 


Attached is the latest Covid report covering the past two weeks. As always. happy to answer anv questions vou might have with 
respect to the report’s contents. 


Additionally. I want to highlight two vaccine-related efforts that launched this week: 


The first is the Whats. App chat bot we launched with the CDC. This Spanish-language bot net only surfaces local vaccine 
appointments. it also links users with free Uber’Lyft rides to their appointments and childcare availability nearby, We're excited by 
the impact this will have en the LatinX vaccination raic. 


Second. I wanted to share that we launched a notification to every Instagram user in the United States encouraging them te visit 
vaccines.gov. After months of state-specific notifications te IG’s +150M users in the US. this is Instagram’s first push to 
vaccines.gov. Based on the demographics of Instagram. we re looking forward to reaching the nation’s youth and to having a 
positive Impact on their vaccination rates. 


Thanks and please don’t hesitate to reach out. 
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Exhibit 40 


Email correspondence between 
Facebook and the White House 


405 


From: Flaherty, Rob EOP/WHO RE 2 «::0.200.90- 


To: 

cc: Rowe, Courtney M. EOP/WHO 

Sent: 5/12/2021 7:52:18 AM 

Subject: RE: [EXTERNAL] FB Newsroom post tomorrow re: our Covid work 


Sure. They're first connected to authoritative information, but then you, as of last night, were presenting an 
anti-vacciné account with less than 1000 followers alongside, at level, with those pinned accounts! 


Here's the thing. You know and | know that the universe of undecided people searching Instagram for “vaccines” — 
as compared to, say, Google -- is probably low. But “removing bad Information from search” is one of the easy, 
low-bar things you guys do to make people like me think you're taking action. If you're not getting that right, it 
raises even more questions about the higher bar stuff. You say in your note that you remove accounts that 
discourage vaccination from appearing in recommendations (even though you're using “primarily” to give yourself 
wiggle room). You also said you don’t promote those accounts in search. Not sure what else there is to say. 


Youtube, for their warts, has done pretty well at promoting authoritative info in search results while keeping the bad 
stuff off of those surfaces. Pinterest doesn’t even show you any results other than official information when you 
search for “vaccines.” | don’t know why you guys can't figure this out. 


From fb.com> 
Sent: Wednesday, May 12, 2021 9:35 AM 
To: Flaherty, Rob EOP/WHO < who.eop.gov> 

Ce: Rowe, Courtney M. EOP/WHO who.eop.gov> 
Subject: Re: [EXTERNAL] FB Newsroom post tomorrow re: our Covid work 


Thanks Rob — both of the accounts featured in the tweet have been removed from Instagram entirely for breaking 
our policies. We're looking into what happened. 


Taking a step back, when searching for terms related to vaccines on Instagram, people are first connected with 
resources from experts. That means that before anything, if someone is looking to get information about 
COVID-19 or vaccines, they are encouraged to seek that information out from the most credible sources. To do 
this, anyone who searches for information related to COVID-19 or vaccines on Instagram is first shown an 
educational pop-up on top of search results connecting them, in the U.S., to the CDC website {as shown in the 
tweet). We've also pinned authoritative accounts in the top search results which is why you also see the CDC and 
Gavi, the Vaccine Alliance Instagram accounts first in the results page. 


We are continuing to develop technology to improve the quality of search results at scale across Instagram — this 
i$ a continual process built on new technology to address adversarial accounts. Our goal is to not recommend 
accounts like those shown in the tweet in search, which again shouldn't have been on our platform to begin with. 
We also remove accounts that may discourage vaccination from search by developing and using this new 
technology to find accounts on Instagram that discourage vaccines, and remove these accounts from search 
altogether. We've also removed accounts that primarily discourage vaccination from appearing where we 
recommend new accounts to follow, such as accounts you may like, and suggested accounts. 


We clearly still have work to do to, but wanted to ensure you were aware of the authoritative resources we're 
pointing people to first as we continue investing In removing accounts from search that may discourage 
vaccination. 


From: Flaherty, Rob EOP/WHO SE ow 0. cop. gov> 
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Date: Tuesday, Mey 11, 2021 at 8:08 PM 

To: fb.com> 

Ce: Rowe, Courtney M. EOP/WHO <P a wno.c0p.gov> 
Subject: Re: [EXTERNAL] FB Newsroom post tomorrow re: our Covid work 


Hard to take any of this seriously when you're actively promoting anti-vaccine pages in search 


>https:/Awitter.com/jessreports/status/1392182161512361984?s=21< 


Sent from my iPhone 


On May 10, 2021, at 7:53 PM, IG tb com> wrote: 


Rob and Courtney—1 wanted to preview a newsroom post and some additional press outreach that we plan to put 
out tomorrow with some updates on our Covid efforts - a large part of which will be focused on what we've been 
doing to help meet vaccination goals. 


Since January, we and our partners have been using trusted messengers and personalized messaging on our 
olatforms to increase vaccine acceptance, and we're seeing positive impact at scale. For example: 


e Over 3.3 million people have visited the vaccine finder tool since its launch on March 11, using it to get 
appointment information from a provider's website, get directions io a provider, or call a provider. In 
addition, we’re showing people reliable information about whether and when they’re eligible to get vaccinated 
through News Feed promotions and our COVID-19 Information Center West Virginia’s Department of 
Health and Human Resources reported that their vaccine registrations increased significantly after Facebook 
started running these notifications. 
Since January, we've provided more than $30 million in ad credits to help governments, NGOs and other 
organizations reach people with COV!D-19 vaccine information and other important messages. These 
information campaigns resulted in an estimated 10 billion ad impressions globally. 
More than 5 million people globally have used these profile frames. And more than 50% of people in the US 
on Facebook have already seen someone use the COVID-19 vaccine profile frames. We spun up this effort 
in partnership with HHS/CDC after public health experts told us that people are more likely to get a vaccine 
when they see someone they trust doing it. 
e As you know, since April 2020, we've been collaborating with Carnegie Mellon University and University of 
Maryland on a global survey of Facebook users to gather insights about COVID-19 symptoms, testing, 
vaccination rates and more. In the US: 


o Vaccine acceptance has been increasing steadily since January, increasing nearly 10% among all US 
adults. 

o We observed a particularly large increase in vaccine acceptance within certain populations in the US. 
Vaccine acceptance increased 26% among Black adults and 14% among Hispanic adults. 

o Vaccine access also remains a challenge. Among adults who intend to get vaccinated (but have not 
yet), 36% feel uninformed about how to get a vaccine and only 22% reported that they have an 
appointment in April. 

We saw the announcement last week of the 70% goal, and we're eager to help support your efforts to reach that 
geal by July 4th. In particular, through our work on both voter registration and vaccines, we’ve had success with a 
targeted strategy for our in-product messages. If there are specific states/regions (or other population segments) 
you're targeting to reach that goal that you can share with us, we can look at how we might be able to adjust our 
im-product efforts to help amplify your efforts. We'd be happy to schedule a follow-up call with the right people to 
drill down on how we might be able to help with these efforts. 


As always let me know if you have any questions. 


Thanks, 
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Exhibit 41 


Email correspondence between 
Facebook and the White House 


409 


From: HR <= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251 CO920BB487E8111461E3692A624> 


To: who.eop.gov 
Sent: 5/15/2021 7:45:43 AM 
Subject: Fwd: Message from Nick Clegg 
Attachments: 14 - COVID-19 Insights.pdf 


Rob—making sure you received as well—apologies for not sending last night. 


Get Outlook for 1OS 


From: Nick Clegg <@fb.com> 

Sent: Friday, May 14, 2021 10:12:04 PM 

To: Slavitt,_ Andrew M. EOP/WHO <_Jo wo. eop.gov> 
Cc: I  fb.com> 

Subject: Message from Nick Cleag 


Hi Andy, 


I wanted to share the latest report from our team with you on most viewed v vaccine content in the US for the 
weeks of 4/19 - 4/25, and 4/26 - 5/2 — attached. Spee 


As with our previous report we sent to you, we saw 5 posts (4.1n the ‘first week, and | in the second) that did not 
violate our community standards but were posts that suggested vaccines are unsafe or reported on vaccine 
adverse effects without context. All of these should have been demoted. Since our last report, we've put in place 
a number of changes on both the technical and operational Side to ensure we're closing the eaps that were 
surfaced tn that report. We've made those changes over the past two w eeks - including additional etforts to 
monitor viral content and demoting more content th at We see going viral - but they aren't reflected in this report’s 
data given the date range. : 


COVID- 19 vaccines. We are eens with our recent ee a help people find atch and where aes can get 
vaccinated: we've been working with Boston Children's Hospital to help people book vaccine appointments in the 
US in just a few taps by connecting them with local vaccination sites. Over 3.3 million people have visited the 
vaccine finder tool since its launch on March | 1, using it to get appointment information from a provider's 
website, vet directions to a provider or call a provider. 


We also announced that since January, we've given more than $30 million in ad credits to help governments, 
NGOs and other organizations reach people with COVID-19 vaccine information and other important messages. 
These information campaigns resulted in an estimated 10 billion ad impressions globally, 


We know from public health research that people are more likely to get vaccmated if they see others in their 
community doing so. In countries where vaccines are available to most of the population, like the US and the Uk, 
we ramped up our efforts to show people when their friends and neighbors share their support for vaccines 
through profile frames and stickers. More thar 5 million people globally have used these profile frames. 


Lastly, as you know, an important part of our work to increase vaccinations 1s to address content that violates our 
rules on c OVID-19 and vaccine misinformation and this week we Pcontinmed He wee aes more an 16 


We also shared some ee data from our Symptom Survey regarding vaccine acceptance in the US: 
- Vaccine acceptance has been increasing steadily since January, increasing nearly 10% among all US 
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adults. 


- We observed a particularly large increase In vaccine acceptance within certain populations in the US. 
Vaccine acceptance increased 26% among Black adults and 14% among Hispanic adults. 


- Vaccine access also remains a challenge. In April, among adults who intend to get vaccinated (but have 


not yet), 36% felt uninformed about how to get a vaccine and only 22% reported that they have an 
appointment. 


The team was also grateful to meet with Becca Siegel at HHS this week to discuss how we can partner more to 
support the Administration’s July 4th vaccination goal — I know there’s plenty of follow up which we're pursuing 
now. 

As ever, happy to discuss any of this if helpful. 


Best 


Nick 
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Exhibit 42 


Internal Facebook email 
correspondence 


412 


From: </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=TUCKER BOUNDS19D> 
To: Joel Kaplan 
ce: — 
Sent: #2021 1:40:57 PM 
Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


All good on our end. We have reactive prepared. 

On May 26, 2021, at 12:33 PM, Joel Kaplan TEE: com> wrote: 

Yes, as long a8 we can cover then if others raise specific instances to our or 3 PFC attn. so effectively an 
“escalations only” approach 


Get Outlook for 1OS 


From: fb.com> 
Sent: Wednesday, May 25, 2021 12:10 PM 

To: Joel Kaplan; 
Clegg; 
Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Yes. This Is from aa They've been working with the team on this & are planning to proactively reach out to 
SPFCs tomorrow (full messaging here). We agree that 3PFCs should update older ratings when they become 
aware that an older post is going viral again or gaining attention again, which applies to the Tucker Carlson content 
delow — that's what we'l plan fe convey. 

The practical issue with updating al! older ratings is that we're talking about potentially hundreds of ratings from 
more than a year ago. The vast majority of this content has zero visibility today, so we con't want to require 
3PFCs to comprehensively update ratings that no one is seeing. Huge lift & not a good use of time. 


Is everyone okay with this? 


From: Joel Kaplan <joelkaplan@fb.com> 


Date: Wednesday, May 26, 2021 at 2:46 PM 
a SE: 
fo. com>, Mo fb.com>., fo com>, 
fb.com>, Nick Clegg fF Ofb.com>, Ef com> 


Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Thx all. a can your team take for action with 3 PFCs? 


Get Outlook for iOS 


From: Mfb.com> 
Sent: Wednesday, May 26, 2021 11:00 AM 


Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 
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Agree 


From: iT of. com> 

Date: Wednesday, May 26, 2021 at 1:40 PM 

To: Joel Kaplan (IQ fb.com>, Es {> com>, 
fb.com>, @fb.com>, TG (5.com>, 
fb.com>, Nick Clegg {iio f>.com>, SES tb.com> 


Subject: RE: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


| don't get a vote here, but! agree. At the very most these claims — depending on how written —maybe deserve a 
“missing context” if they don't acknowledge the uncertainty, but even that may be off. They definitely cannot 
credibly maintain the false rating... . 


From: Joe! Kaplan fo.com> 
Sent: Wednesday, May 26, 2021 10:21 AM 


.com>; Nick Clegg qa fb.com>; Pr al 


Subject: Fwd: [For Decision] Recommendation to stop removing claims that COVID-19 is marn-‘made 


In ight of all the developments on this front, including this statement from President Biden today, it does not seem 
credible or appropriate for 3 PFCs to maintain false ratings on claims—arguments, really—that Covid beganina 
lab, unless the 3 PFCs are equally prepared to label claims that It evolved naturally. Given the degree of scrutiny 
this issue Is now receiving, and the significant impact this episode will have on the credibility of the fact-checking 
enterprise more broadly, it seems worth it to me in this instance to push the 3 PFCs to lift these past ratings until 
this issue Is more definitively resolved. IMHO, it’s an embarrassment to them and us to maintain these ratings. 


httos://twitter.com/phil_ mattingly/status/13975956651029340187s=21 


From: @tb.com> 
Sent: Tuesday, May 25, 2021 12:26 PM 
To: Joel Kaplan; 
Subject: Re: [For Decision] Recommendationto stop removing claims that COVID-19 is mar-made 


Joel, 


Following up on the below, 3PFC Partnerships spoke with editors from Politifact, one of the 3PFCs 
that rated the Tucker Carlson video (IG video link here) and that updated their fact check to note the 


e The editors said they would likely still rate this IG video False today. This is because, despite increased 
discussion, there is still no evidence that Covid-19 was created in a lab, and Carlson categorically affirms 
the Chinese virologist’s claim that it was, without providing supporting evicence. 

¢ Politifact is not planning to re-review all ratings on older content that were accurate at the time, as this is not 
standard practice in our program. However, they will consider re-reviewing old content whervif they become 
aware that is getting new views. 

¢ For example, they changed a Sept. 2020 rating ona second Carlson video (FB link here), which focused on 
FB’s “censorship” of the original video, from Partly False to Missing Context because it was likely to get new 
views from Fox’s weekend coverage. As a reminder, we judged this second video not to be a “Repeatedly 
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Fact Checked Hoax” because it focused on claims of censorship, rather than the claim that Covid-19 was 
man-made. 


With this in mind, our plan going forward is: 
¢ We will still fake no action on the Carlson IG video in question. It will continue to show the False rating, and 
the FB version will continue to stay removed per our original policy. (Note that the 3PFC rating on the IG 
video does not carry a misinfo strike because the content is older, and similarly the removal of the FB video 


does not carry a CS strike.) 

° Per EM eri to Nick, we will begin to stop removing new content with the claim Covid-19 is 
mar-made tomorrow, and are briefing the White House on this change this afternoon. 

e Accordingly, 3PFC Partnerships will ask that, when/if 3PFCs become aware of older content that has newly 
gone viral and makes this claim, they prioritize updating those ratings. 


Please let us know if you'd like any further follow up, and thanks a4 lot. 


From: fb.com> 
Date: Tuesday, May 25, 2021 at 7:06 AM 


Tick i > Econ, iT 


Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Hi Joel, of course. 
« The way it works that we are finding content with claims that are repeatedly fact checked and removing them 
ourselves. We are not currently waiting for 3PFCs to rate them. 
« When we stop this, it means we will no longer take any action ourselves, meaning we won't find the claim 
and remove, nor would we find it and demote/label ourselves. 
e However as you say, a fact checker coud still take action on this claim themselves. So if Tucker Carlson (or 
anyone} makes this claim again, a 3PFC could rate it if they so choose, independent of us. 


'm ccing i (our lead for this policy) to follow up more, as | know we're following up with 
Partnerships on your questions from last night as wel-—and just let us know if there’s more in the meantime. 


Thanks a lot, 


Get Outlook for iOS 


From: Joel Kaplan <joelkaplan@fb.com> 
Sent: Tuesday, May 25, 2021 6:27:47 AM 
10: sf. com>; i tb com> 


Subject: Re: [For Decision] Recommendationto stop removing claims that COVID-19 is man-made 


Mc an you please remind me how RFHs work? Is it just a question of whether we remove {if it’s an RFH)} 
something that the 3 PFC rates, or is it that we fan out and remove RFHs without waiting for 3 PFCs to rate? So, 
when you say we will stop removing claims that COVID-19 is man-made under our COVID-19 
Repeatedly Fact Checked Hoaxes (RFH) policy, what does this mean in practice the next time 
Tucker Carlson makes this claim? Does it mean the claim can't be rated false, flagged, and 
demoted? Or just that we will wait for the 3 PFC to rate it without taking any affirmative action? 


Get Qutlock for ioS 
From: i © (b>.com> 
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Sent: Monday, May 24, 2021 9:59:15 PM 


@fb.com> 


@tb.com>: MisinfoPolicyTeam fb.com>; 
, co" fb.com>; Strategic Response 
b.com> 


Subject: Re: [For Decision] Recommendationto stop removing claims that COVID-19 is manmade 


Hi Joel, we know they can't {technically} change the rating right now because the content on FB has been deleted. 
We are not sure if they would change the rating if they could, and we'll work with 3PFC Partnerships to follow up on 
that specifically. 


Also to confirm, you are correct, we did not delete the video from IG—the video is still live there. The fact 
checkers just can't change the rating on the IG video themselves, because we {FB) applied the rating, based on 
their original rating of the {now deleted) FB video. 


If the fact checkers tell us they would want to remove the rating, we could decide to override it manually on the 
back end. The complicating factor of course is that, in this case, we'd have to decide if we want to restore the 
Original content we removed. As per below we have recommended to leave this content down consistent with our 
original policy, but will follow up tomorrow after discussing with Partnerships. 


Thanks again, and let us know if you have more cuestions. 


From: Joel Kaplan fo. com> 
Date: Monday, May 24, 2021 at 6:38 PM 
To: @to.con>, ie: con>, 


Ce: @fb.com>, MisinfoPolicyTeam fb com>, 
fo.com>, fb.com>, fb.com>, 
rategic Response Pol icy fo. com> 


Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Thanks {J When you say that the fact checkers haven’t changed their false rating, is that 
because they are declining to change a rating, or because there is no way for them to do so {because 
the content has been deleted)? 


Also, | thought we learned on Friday that we had NOT deleted the video from IG? Wasn’t that the 
issue that flagged Friday evening and we decided NOT to enforce? 


Thx 


Get Outlook for iOS 


From: iS cib.com> 


Sent: Monday, May 24, 2021 9:25 PM 
To: Joel Kaplan; TEE 

Ce: MisinfoPolicyTeam; ——_———————— ry Strategic 
Response Policy 

Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Joel, 
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To your questions, specific to the Tucker Carlson video, there were three fact-checkers who rated the video False. 
None of those fact-checkers have amended their False ratings, although two of them have amended their 
fact-checking articles to state the issue is now in dispute. What makes this more complicated is that the 3PFCs 
rated the video on Tucker Carlson's FB page, and we fanned-out automatically and applied the ratings to the same 
video on Carison’s IG Account. Now that the content was deleted on FB, the 3PFCs do not have the technical 
capability to change the ratings. 


To your other questions, yes, we have precedent. For content live on the platform, when a rating is later reversed, 
our systems automatically remove the overlay and all enforcement. 


Some partners have told 3PFC Partnerships that they think some content with this claim that they rated last year 
should still be rated False, because it was based onthe most credible sources at the time. That said, we are 
following up with the Partnerships team to see if we can get more detail on what partners are planning on their 
previous ratings. 


Thanks a lot 
From: Joel Kaplan <li f..com> 


Date: Monday, May 24, 2021 at 4:52 PM 

To: fb.con>, ii EE 3613. com> 

Ce: @fb.com>, MisinfoPolicyTeam fb.com> 
0. corn >, a 6. com>, @fb.com>, 


Strategic Response Policy Gfb.com> 
Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Thanks. Did the fact-checkers amend their actual ratings? Do we have any precedent for how we 
treat articles that were subject to a false rating that is later reversed? ['m not sure what grounds we 
would have if someone “appealed” a prior rating/strike based on a fact-check that has been 
withdrawn. In most cases, it probably goes unnoticed. Here, that’s unlikely to be the case because 
of the high profile nature of the debate. 


Get Outlook for iOS 


From: fo. com> 
Sent: Monday, May 24, 2021 6:29 PM 


To (EE 0¢! Kaplan 
Cc: AMINE sinfoPotcyTeam: ee Str2tecic 


Response Policy 
Subject: Re: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Thanks, GRRE sourcs good. 


From: I (0, com> 
Date: Monday, May 24, 2021 at 3:28 PM 

To: Joel Kaplan GE (cor 
Ce: isi 
TE) f5. com>, 


Strategic Response Policy 
Subject: [For Decision] Recommendation to stop removing claims that COVID-19 is man-made 


Hi Joel ancl 
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We are seeking your approval to stop removing claims that COVID-19 is man-made under our 
COVID-19 Repeatedly Fact Checked Hoaxes (RFH) policy. 

¢ Status Quo: Under our RFH policy, we remove claims that “COV1D-19 is man-made, manufactured, 
bioengineered, a bioweapon, or created by an individual, government or country.” 

e Reason for the Change: Generally, heaith experts still believe that COVID-19 was most likely transmitted 
from animals to humans. However, there is a renewed debate on the topic, indicating the issue is no longer 
settled, including the following: 

o WHO: In March 2021, the WHO issued a report calling for further studies and data on the origin of 
COVID-19, and “reiterate[d] that all hypotheses remain open.” The Director General said they do not 
yet know the origin of the virus and are continuing to investigate the matter. 

o CDC: The CDC told us last week ‘hat they could not debunk the claim that COVID-19 is man-made 
and considered it to be inconclusive, saying specifically that the claim is theoretically possible, but 
extremely unlikely. 

o Dr. Fauci: On May 11, 2021, Dr. Fauci stated that he is “not convinced” COVID-19 developed naturally 
and welcomes additional investigations. This statement prompted two of our 3PFCs (Politifact and 
FactCheck org) to amend their false rating of the claim, pending additional investigations. 

* Rationale for Not Removing this Claim. We generally only add claims to our policies where the science 
and debate is stable and unlikely to change in the short term. In addition, this claim no longer meets our 
falsity assessment because, while it is unsupported by evidence, it is considered “disputed” with ongoing 
investigations looking into the maiter. 

® Implementation: We would not restore prior removals because this claim was violating at the time when 
those removals occurred, which is consistent with how we have approached most other updates to this 
policy. Fact checkers could still rate versions of this claim, but we expect they will take into account the new 
uncertainty about whether it is false. 


aa 


Detailed recommendation on not removing claims that COVID-19 is man-made 

« Why we added this claim: We added this to the COVID-19 RFH policy in 2020 after multiple 3PFCs had 
rated this claim false. Early in the pandemic, health experts largely rejected the possibility that COVID-19 
was mar-made or bioengineered, given the close genetic resemblance to bat coronaviruses, similar 
experience with other pathogens, and the absence of other countervailing evidence. Originally, we did not 
remove this claim; we later decided to remove all RFHS, including this claim, in February 2021. 

e What experts are saying now: There has been renewed debate on whether the virus could be man-made or 
leaked from a lab. Specific highlights include: 

o 3PFCs: Politifact updated its fact-check from September 2626 because the claim that COVID-19 
could not have been manipulated is now more widely disputed. They removed their fact-check pending 
a more thorough review, although they consider this claim to be unsupported by evidence and in 
dispute. FactCheck.org updated its September 2020 fact-check last week, to say that the exact origin 
of the virus remains unknown. 

o CDC: The CDC told us they could not debunk this claim and considered it to be inconclusive. They 
consider the claim “COVID-19 is man-made" to be theoretically possible, but extremely unlikely” 

o WHO Director General: Following the WHO's research trip to Wuhan in February, the DG concluded 
on March 30, 2021 that “a laboratory leak is the least likely hypothesis [although] this requires further 
investigation, potentially with additional missions involving specialist experts... We have not yet found 
the source of the virus, and we must continue to follow the science and leave no stone unturned as we 
do.” 

9° Dr. Fauci: While on a panel with Politifact on May 11, 2021, Dr. Fauci is asked whether he is still 
convinced that the virus developed naturally. He responds (at 13:00) by saying “I’m not convinced 
about that. | think we should continue to Investigate what went on in China until we find out exactly what 
happened... People who have investigated have said that it likely was an emergence from an animal 
reservorr that then infected individuals, but It could have been something else and we have to find that 
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out. I'm perfectly in favor of any investigation that looks into the origin of the virus.” 

o News reporting: The Federalist reports “Politifact quietly retracts fact check of COVID wuhan lab 
theory”; Fox News says “Fauci 'nct convinced’ COV/D-19 developed naturally"; WSJ finds 
“Intelligence on sick staff_at Wuhan Lab fuels debate on COVID-19 origin’; The Hill called the 
revelation a “Fauci bombshell” 

« Argument for removing: The CDC believes the claim that COVID-19 was man-made by China has fuelled 
the rise in anti-Asian racism and physical attacks on people of Asian descent inthe U.S. This claim is 
prevalent on the platform (it is our most actioned RFH claim) so allowing this content back on the platform 
could potentially contribute to the risk of imminent physical harm to Asian-Americans. 

« Argument for allowing: Debate is ongoing and likely to change as more investigations occur. We generally 
only add claims to our policies where the science and debate is stable and unlikely to change in the short 
term. Additionally, this claim no longer meets our threshold for falsity. Claims can be “unsupported by 
evidence” and a) likely false with health experts not investigating further (e.g. “COVID-19 vaccines cause 
autism’) or; b) likely false but where health experts are actively investigating. 

e How we plan to implement: As with other changes we make to our COV/D-19 misinformation policies, we 
do not plan to restore previously removed content. This is because the policy changes to reflect updates in 


the science and health expert quidance end, at the time, these claims violated our policies. We plan to: 
9 Stop enforcing on escalation on Thursday 


o Stop scaled enforcement by June 9 
o Update the external help centre by Thursday 


Reon Product Policy Manager 
isinformation 7 Team 


| sinnatiira 17° 
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From: Flaherty, Rob EOP/WHO <ER wini0.cop.gow 
To: Qureshi, Hoor EOP/WHO 

Sent: 5/30/2021 8:33:52 AM 

Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


Think it’d be helpful to talk through. Hoor can help find a time early this week. 


Sent from my 1Phone 


On May 28, 2021, at 6:36 PM J © 1. com> wrote: 


Rob—FYI—let me know if helpful to connect. Have a good holiday weekend. 


Get Outlook for 1OS 


From: Nick Clegg fb.com> 


Sent: Friday, May 28, 2021 5:48:14 PM 
To: Slavitt, Andrew M. EOPAWHO < 


q 


@who.eop.gov>; Murthy, Vivek (HHS/OASH) 


hhs.gov> 
ce fb.com> 
Subject: Message from Nick Clegg 


Dear Andy, dear Vivek {if | may}, 
Thanks again for the time the other day. 


As promised, I’m sending our latest report that includes topline performing posts for the weeks of 5/3-5/9 and 
5/9-5/15. Report is attached, and myself and the team are of course happy to discuss anything within. 


| also want to highlight a few policy updates we announced yesterday regarding repeat misinformation. The full 
Newsroom post with product mock ups is available here, but | wanted to call out a few key points: 


1. We've added more context about Pages that repeatedly share false claims; 
2. We are expanding penalties for individual Fecebook accourts that share misinformation; and 
3. We've redesigned notifications when they share content that a fact-checker later rates. 


Finally, | wanted to include here the data | mentioned on our call earlier that point to the positive {if not as publicly 
discussed} influence we're having on attitudes toward vaccines: 


Overall trends in vaccine acceptance amongst Facebook users are positive: this has increased 
considerably since January, and racial/ethnic disparities have also decreased. 

Since January, vaccine acceptance in the US from a daily survey of Facebook users {done in partnership with 
CMU) has *increased* by 10-15 percentage points (e.g. 70 %-> 80-85%}, and racial/ethnic disparities in 
acceptance have shrunk considerably (e.g. some of the populations that had the lowest acceptance in January had 
the highest increases since). 


Not only are the overall trends increasing, we also have data showing our efforts are contributing: including 
some of our specific collaborations with HHS/CDC and work around trusted messengers and messaging. 
Over the same time period, we've been working closely with partners to run the largest scale on line campaign in 
support of vaccination efforts. We've deliverec over 10B ad impressions from health partners worldwide since 
January, and have also run significant or-platform product promctions. These have been focused on 3 goals: i) 
increase access to vaccines; ii) help people get questions answered; iii) socially normalize the vaccine. 
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Early evidence that these are increasing drivers of vaccination, at scale, include: 

© Social Norming: 50 percent of Facebook users have seen someone they follow (e.g. friend, family 

member, community leader, public figure} use an HHS/CDC vaccine frame. Research from MIT 
shows that similar types of social normalization efforts can meaningfully improve people's likelincod to get 
vaccinated, which is consistent with other expert advice (e.g. “Encouraging those who are vaccinated to 
show their vaccination status with pride, both online and offline, can nudge their family, friends and networks 
to follow suit.”). We are seeing some encouraging preliminary results in vaccine sentiment {the safety and 
importance of COVID-19 vaccines) in the US through our surveys as a result of vaccine profile frame 
promotions. As a result, we are scaling the launch of these features globally. 

« Access: Over 3M people have used our Vaccine Finder since March, developed in partnership with 
Boston Children’s Hospital. We've been promoting Vaccine Finder and eligibility information to all people 
on Facebook in close partnership with states, which are seeing impact. For example, West Virginia reported 
a meaningful increase in vaccine registrations after we started our efforts. 

Education: A single “Facts about COVID19” News Feed campaign—that reached 100s of millions of 

people worldwide--increased belief in key facts about vaccine safety and testing by 3% across 5 

countries. We've directed 2B+ people to expert health resources through the Covid Info Center, which in 

the US includes information from local county-level public health departments. We observed a particularly 
large increase in vaccine acceptance within certain populations in the US. Vaccine acceptance increased 

26% among Black adults and 14% among Hispanic adults. 

e Equity: We're more frequently reaching peopie in areas with lower vaccination rates using CDC's 
Social Vulnerability index. We are partnering with a wide range of organizations to deliver trusted, 
accessible messages; Spanish-language campaigns from AARP and Johns Hopkins University’s 
Bloomberg School of Public Health; and CARE US for conservative audiences. Our work to promote 
information on how to get a vaccine to high-SVI zip codes increased confidence that people in those zip 
codes have in being able to get a vaccine. 


This builds on work—and uses similar strategies—to what we did over the last few years to support flu 
vaccination, mask wearing, blood donation, and voting, all of which also had meaningful population-level 
positive impact. 

e Fiu Vaccination: We employed similar strategies with partners around a major flu vaccination campaign last 
fall. These reached 10s of millions of people in the US; some of these campaigns increased perceived 
safety or intent by 3-5%. 

e Mask Wearing: Social normalization campaigns reaching millions of people featuring trusted public figures 
increased mask wearing behavior and attitudes by 3-8%. This included the “You Will See Me” campaign 
from CDC Foundatior/Ad Council. Note that mask wearing attitudes and reported behaviors increased 
dramatically since early spring 2020, and by summer the vast majority of all people in the US reported 
wearing masks, a trend mirrored in CMU’s large-scale survey of Facebook users. 

e Biood Donations: Our blood donations product—which notifies people nearby about opportunities to donate 
blood, and makes it easy for them to find a schedule an appointment—increased first time donors across 
the US by 19% when we rolled it out across sites from the American Red Cross, Vitalant, Versiti, and New 
York Blood Centers. 


We think there’s considerably more we can do in partnership with you and your teams to drive behavior. We're also 
committed to addressing the defensive work around misinformation that you've called on us to address. But we 
don't want to miss the full story of Facebook’s impact on attitudes toward vaccine acceptance—we believe our 
work is paying real dividends in the form of more people getting shots, and we believe data bears this out. We're 
eager to find additional ways to partner with you. 


All my best wishes, 


Nick 


<§ 28 - COVID-19 Insights. pdf> 
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From: GS </O= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251 C0920BB487E8111461E3692A624> 


To: Flaherty, Rob EOP/WHO 

cc: Qureshi, Hoor EOP/WHO; Sx 
Sent: 6/2/2021 7:50:06 PM 

Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


Great—will find time tomorrow and lock it in. thanks. 


From: Flaherty, Rob EOP/WHO <I Qwho. cop. gov> 
Date: Wednesday, June 2, 2021 at 10:29PM 
[o: I C2 com> 


Ce: Qureshi, Hoor EOP/WHO <i Qwho.cop.gov>, Si @fb.com> 


Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


| think maybe let’s just chat 1:1 for now? Don’t need a big group. Might help to consolidate this and the other recent 
convo your higher ups had with I. 


Sent from my iPhone 


On Jun 2, 2021, at 8:29 PM, iG fb.com> wrote: 


Hope I’m not making this more difficult than it needs to be—happy to just schedule and if we don't have right folks 
on the line to answer q’s we will take them back. VVill plan to have someone who knows the report and the policy 
changes that were announced. Will confirm a time ASAP. 


Get Outlook for iOS 


From: fb.com> 

Sent: Tuesday, June 1, 2021 1:54:57 PM 

To: Flaherty, Rob EOP/WHO ~< Qwho.cop.gov>; Qureshi, Hoor EOP/WHO 
who.eop.gov> 

Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


Working on scheduling—want to make sure to have the right folks on a call to respond to questions—are you 
hoping to cover the policy changes or the content in the report (or both)? Or happy to just schedule 1:1 if there’s 
something higher level. 


From: Flaherty, Rob EOP/WHO {i Qwho. cop. gov> 

Date: Sunday, May 30, 2021 at 11:34 AM 

To: © fb.com>, Qureshi, Hoor EOP/WHO <I @who.eop. gov> 
Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


Think it'd be helpful to talk through. Hoor can help find a time early this week. 


Sent from my iPhone 


On May 28, 2021, at 6:36 PM, AG fb.com> wrote: 


Rob—FY|I—let me know if helpful to connect. Have a good holiday weekend. 
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Get Outlook for iOS 


From: Nick Clegg <J@fb.com> 
Sent: Friday, May 28, 2021 5:48:14 PM 


To: Slavitt, Andrew M. EOP/WHO <I @ who.eop.gov>; Murthy, Vivek (HHS/OASH) 
EEE hs cov> 
Cc: EE fb.com> 


Subject: Message from Nick Clegg 
Dear Andy, dear Vivek (if | may), 
Thanks again for the time the other day. 


As promised, I’m sending our latest report that includes topline performing posts for the weeks of 5/3-5/9 and 
5/9-5/15. Report is attached, and myself and the team are of course happy to discuss anything within. 


| also want to highlight a few policy updates we announced yesterday regarding repeat misinformation. The full 
Newsroom post with product mock ups is available here, but | wanted to call out a few key points: 


1. We've added more context about Pages that repeatedly share false claims; 
2. We are expanding penalties for individual Fecebook accounts that share misinformation; and 
3. We've redesigned notifications when they share content that a fact-checker later rates. 


Finally, | wanted to include here the data | mentioned on our call earlier that point to the positive (if not as publicly 
discussed) influence we're having on attitudes toward vaccines: 


Overall trends in vaccine acceptance amongst Facebook users are positive: this has increased 
considerably since January, and racial/ethnic disparities have also decreased. 

Since January, vaccine acceptance in the US from a daily survey of Facebook users (done in partnership with 
CMU) has *increased* by 10-15 percentage points (e.g. 70 %-> 80-85%), and racial/ethnic disparities in 
acceptance have shrunk considerably (e.g. some of the populations that had the lowest acceptance in January had 
the highest increases since). 


Not only are the overall trends increasing, we also have data showing our efforts are contributing: including 
some of our specific collaborations with HHS/CDC and work around trusted messengers and messaging. 
Over the same time period, we've been working closely with partners to run the largest scale on line campaign in 
support of vaccination efforts. We've delivered over 10B ad impressions from health partners worldwide since 
January, and have also run significant on-platform product promotions. These have been focused on 3 goals: i) 
increase access to vaccines; ii) help people get questions answered; iii) socially normalize the vaccine. 


Early evidence that these are increasing drivers of vaccination, at scale, include: 

e Social Norming: 50 percent of Facebook users have seen someone they follow (e.g. friend, family 
member, community leader, public figure) use an HHS/CDC vaccine frame. Research from MIT 
shows that similar types of social normalization efforts can meaningfully improve people’s likelihood to get 
vaccinated, which is consistent with other expert advice (e.g. “Encouraging those who are vaccinated to 
show their vaccination status with pride, both online and offline, can nudge their family, friends and networks 
to follow suit.”). We are seeing some encouraging preliminary results in vaccine sentiment (the safety and 
importance of COVID-19 vaccines) in the US through our surveys as a result of vaccine profile frame 
promotions. As a result, we are scaling the launch of these features globally. 

e Access: Over 3M people have used our Vaccine Finder since March, developed in partnership with 
Boston Children’s Hospital. We've been promoting Vaccine Finder and eligibility information to all people 
on Facebook in close partnership with states, which are seeing impact. For example, West Virginia reported 
a meaningful increase in vaccine registrations after we started our efforts. 

e Education: A single “Facts about COVID19” News Feed campaign—that reached 100s of millions of 
people worldwide--increased belief in key facts about vaccine safety and testing by 3% across 5 
countries. We've directed 2B+ people to expert health resources through the Covid Info Center, which in 
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the US includes information from local county-level public health departments. We observed a particularly 
large increase in vaccine acceptance within certain populations in the US. Vaccine acceptance increased 
26% among Black adults and 14% among Hispanic adults. 

e Equity: We're more frequently reaching people in areas with lower vaccination rates using CDC's 
Social Vulnerability Index. We are partnering with a wide range of organizations to deliver trusted, 
accessible messages; Spanish-language campaigns from AARP and Johns Hopkins University’s 
Bloomberg School of Public Health; and CARE US for conservative audiences. Our work to promote 
information on how to get a vaccine to high-SVI zip codes increased confidence that people in those zip 
codes have in being able to get a vaccine. 


This builds on work—and uses similar strategies—to what we did over the last few years to support flu 
vaccination, mask wearing, blood donation, and voting, all of which also had meaningful population-level 
positive impact. 

e Flu Vaccination: We employed similar strategies with partners around a major flu vaccination campaign last 
fall. These reached 10s of millions of people in the US; some of these campaigns increased perceived 
safety or intent by 3-5%. 

e Mask Wearing: Social normalization campaigns reaching millions of people featuring trusted public figures 
increased mask wearing behavior and attitudes by 3-8%. This included the “You Will See Me” campaign 
from CDC Foundation/Ad Council. Note that mask wearing attitudes and reported behaviors increased 
dramatically since early spring 2020, and by summer the vast majority of all people in the US reported 
wearing masks, a trend mirrored in CMU’s large-scale survey of Facebook users. 

Blood Donations: Our blood donations product—which notifies people nearby about opportunities to donate 
blood, and makes it easy for them to find a schedule an appointment—increased first time donors across 
the US by 19% when we rolled it out across sites from the American Red Cross, Vitalant, Versiti, and New 
York Blood Centers. 


We think there’s considerably more we can do in partnership with you and your teams to drive behavior. We're also 
committed to addressing the defensive work around misinformation that you've called on us to address. But we 
don't want to miss the full story of Facebook's impact on attitudes toward vaccine acceptance—we believe our 
work is paying real dividends in the form of more people getting shots, and we believe data bears this out. We're 
eager to find additional ways to partner with you. 


All my best wishes, 
Nick 


<5_28 - COVID-19 Insights.pdf> 
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Exhibit 45 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy 
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From: GE «0-1 HEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8 111461E3692A624> 


To: Flaherty, Rob EOP/WHO 

ce: Qureshi, Hoor EOP/vwHo; 
Sent: 6/15/2021 9:36:53 AM 

Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


Hey Rod—look forward to catching up later today. Just as a reminder—we had planned to cover a few things after 
the last report came over to you-—1) our announcements from May 26; 2) a further discussion on demotion of 
content; 3) the source for the statistics we sent over by email re: impact we're seeing In vaccine acceptance. 


| have a few folks lined up to join the conversatio © leads our health work at Facebook, mee 
MB x0 you've met and leads our research team; and from our product team to cover content 
demotion. 


Let me know if you have any questions ahead of time? 


Thanks, 


From: Flaherty, Rob EOP/WHO SEE 630. cop. gov> 


Date: Wednesday, June 2, 2021 at 10:29 PM 
To: TE o> .com- 
Ce: Qureshi, Hoor EOP/WHO EE oi: 0. 200. gov>, 2 ).con> 


Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


| think maybe let’s just chat 1:1 for now? Don’t need a big group. Might help to consolidate this and the other recent 
convo your higher ups had with 


Sent from my iPhone 


On Jun 2, 2021, at 8:29 PM, ot. com> wrote: 


Hope I’m not making this more difficult than it needs to be—happy to just schedule and if we don't have right folks 
on the line to answer q's we will take them back. Wil plan to have someone who knows the report and the policy 
changes that were announced. Will confirm a time ASAP. 


Get Outlook for iOS 


From: Vfb.com> 

Sent: Tuesday, June 1, 2021 1:54:57 PM 

To: Flaherty, Rob EOP/AWHO <I 0. 20 cov>: Qureshi, Hoor EOPAWHO 
EEE 0.209 cov> 

Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 


Working on scheduling—want to make sure to nave the right folks on a call to respond to questions—are you 
hoping to cover the policy changes or the content in the report (or both)? Or happy to just schedule 1:1 if there’s 
something higher level. 


From: Flaherty, Rob EOP/WHO <M @who. cop. gov> 
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Date: Sunday, May 30, 2021 at 11:34 AM 


To: EE ©) .com>, Qureshi, Hoor EOP/WHO <EEEEEowno. cop. gov> 


Subject: Re: [EXTERNAL] Fwd: Message from Nick Clegg 
Think it'd be helpful to talk through. Hoor can help find a time early this week. 


Sent from my iPhone 


On May 28, 2021, at 6:36 PM, tb com> wrote: 


Rob—FY]—let me know if helpful to connect. Have a good holiday weekend. 


Get Outlook for iOS 


From: Nick Clegg < fb.com> 
Sent: Friday, May 28, 2021 5:48:14 PM 
To: Slavitt, Andrew M. Z[OP/W+0 <{Io who.cop.gov>; Murthy, Vivek (HHS/OASH) 


=. 
Ce: Brian Rice CC 


Subject: Message from Nick Clegg 


Dear Andy, dear Vivek {if | may}, 
Thanks again for the time the other day. 


As promised, I'm sending our latest report that includes topline performing posts for the weeks of 5/3-5/9 and 
5/9-5/15. Report is attached, and myself and the team are of course happy to discuss anything within. 


| also want to highlight a few policy updates we announced yesterday regarding repeat misinformation. The full 
Newsroom post with product mock ups is available here, but | wanted to call out a few key points: 


1. We've added more context about Pages that repeatedly share false claims; 
2. We are expanding penalties for individual Facebook accounts that share misinformation; and 
3. We've redesigned notifications when they share content that a fact-checker later rates. 


Finally, | wanted to include here the data | mentioned on our call earlier that point to the positive {if not as publicly 
discussed) influence we’re having on attitudes toward vaccines: 


Overall trends in vaccine acceptance amongst Facebook users are positive: this has increased 
considerably since January, and racial/ethnic disparities have also decreased. 

Since January, vaccine acceptance in the US from a daily survey of Facebook users {done in partnership with 
CMU) has *increased* by 10-15 percentage points (6.9. 70 %-> 80-85%}, and racial/ethnic disparities in 
acceptance have shrunk considerably (e.g. some of the populations that had the lowest acceptance in January had 
the highest increases since}. 


Not only are the overall trends increasing, we also have data showing our efforts are contributing: including 
some of our specific collaborations with HHS/CDC and work around trusted messengers and messaging. 
Over the same time period, we've been working closely with partners to run the largest scale on line campaign in 
support of vaccination efforts. We've deliverec over 10B ad impressions from health partners worldwide since 
January, and have also run significant or-platform product promotions. These have been focused on 3 goals: 1) 
increase access to vaccines; ii) help people get questions answered; iii) socially normalize the vaccine. 


Early evidence that these are increasing drivers of vaccination, at scale, include: 
e Social Norming: 50 percent of Facebook users have seen someone they follow (e.g. friend, family 
member, community leader, public figure} use an HHS/CDC vaccine frame. Research from MIT 
shows that similar types of social normalization efforts can meaningfully improve people's likelinood to get 
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vaccinated, which is consistent with other expert advice (e.g. “Encouraging those who are vaccinated to 
show their vaccination status with pride, both online and offline, can nudge their family, friends and networks 
to follow suit.”). We are seeing some encouraging preliminary results in vaccine sentiment {the safety and 
importance of COVID-19 vaccines) in the US through our surveys as a result of vaccine profile frame 
promotions. As a result, we are scaling the launch of these features globally. 

e Access: Over 3M people have used our Vaccine Finder since March, developed in partnership with 
Boston Children’s Hospital. We've been promoting Vaccine Finder and eligibility information to all people 
on Facebook in close partnership with states, which are seeing impact. For example, West Virginia reported 
a meaningful increase in vaccine registrations after we started our efforts. 

« Education: A single “Facts about COVID19”" News Feed campaign—that reached 100s of millions of 
people worldwide--increased belief in key facts about vaccine safety and testing by 3% across 5 
countries. We've directed 2B+ people to expert health resources through the Covid Info Center, which in 
the US includes information from local county-level public health departments. We observed a particularly 
large increase in vaccine acceptance within certain populations in the US. Vaccine acceptance increased 
26% among Black adults and 14% among Hispanic adults. 

e Equity: We're more frequently reaching people in areas with lower vaccination rates using CDC's 
Social Vuinerability Index. We are partnering with a wide range of organizations to deliver trusted, 
accessible messages; Spanish-language campaigns from AARP and Johns Hopkins University’s 
Bloomberg School of Public Health; and CARE US for conservative audiences. Our work to promote 
information on how to get a vaccine to high-SVI zip codes increased confidence that people in those zip 
codes have in being able to get a vaccine. 


This builds on work—and uses similar strategies—to what we did over the last few years to support flu 
vaccination, mask wearing, blood donation, and voting, all of which aiso had meaningful population-level 
positive impact. 

e Fiu Vaccination: We employed similar strategies with partners around a major flu vaccination campaign last 

af<'ll. These reached 10s of millions of people in the US; some of these campaigns increased perceived 
safety or intent by 3-5%. 

e Mask Wearing: Social normalization campaigns reaching millions of people featuring trusted public figures 
increased mask wearing behavior and attitudes by 3-8%. This Included the “You Will See Me” campaign 
from CDC Foundatior/Ad Council. Note that mask wearing attitudes and reported behaviors increased 
dramatically since early spring 2020, and by summer the vast majority of all people in the US reported 
wearing masks, a trend mirrored in CMU’s large-scale survey of Facebook users. 

e Biood Donations: Our blood donations product—which notifies people nearby about opportunities to donate 
blood, and makes it easy for them to find a schedule an appointment—increased first time donors across 
the US by 19% when we rolled it out across sites from the American Red Cross, Vitalant, Versiti, and New 
York Blood Centers. 


We think there’s considerably more we can do in partnership with you and your teams to drive behavior. We're also 
committed to addressing the defensive work around misinformation that you've called on us to address. But we 
don't want to miss the full story of Facebook’s impact on attitudes toward vaccine acceptance—we believe our 
work is paying real dividends in the form of more people getting shots, and we believe data bears this out. We're 
eager to find additional ways to partner with you. 


All my best wishes, 


Nick 


<5 28 - COVID-19 Insights. pdf> 
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Exhibit 46 


Internal Facebook email 
correspondence 


From: </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=NELLMDD4> 

To: ‘ck A 5c! 2; en 
p= 

ce: 

Sent: 6/4/2021 4:29:35 PM 

Subject: RE: Wuhan lab leak theory 


Got it. I'll edit accordingly and send up to Mark. Thank you! 


From: Nick Clegg I@fb.com> 


Sent: Friday, June 4, 2021 4:18 PM 
: fb.com>; fb.com>; Joel Kaplan fb.com>; 
Ofb.com->; @fb.com>: @fb.com>: 


ME f.com> 
C : 6 tb com>; I ¢> com> 


Subject: Re: Wuhan lab leak theory 


Got it —v helpful —1 think that distinction between reduction (May 2020-Feb '21) vs removal {Feb ’21-May '21) 
should be made much more explicit plse in what you now send to eal as it was the removal that triagered his 
greatest disquiet. Thx. N 


From: (i 15 com> 


Date: Friday, June 4, 2021 at 3:47 PM 


Subject: RE: Wuhan lab leak theory 


You're not being slow — all our misinfo enforcement is really complicated, which hopefully we can solve for in 
Misinfo 2.0. 


e May 2020 — Feb. 2021: for claims that multiple fact checkers rated false, including claims that the virus was 
mar-made, bioengineered, modified through gain of function research, FB reduced distribution of the claims 
and added a label that the claim had been rated false with a link to a fact check. 

¢ Feb. 2021: same set of claims as described above, but we started removing them. 

« May 2021: fact checkers withdrew the fact checks about man-made claims, so we stopped removing claims 
about covid being marn-made/bioengineered/modified through research {and we do not reduce or label these 
claims) 


From: Nick Clegg fb.com> 
Sent: Friday, June 4, 2021 3:39 PM 


@fb.com>; Joel Kaplan HB 2 fb.com>; 


Subject: Re: Wuhan lab leak theory 


Sorry —I’m being v slow — so what exactly did we “enforce” between May 2020 and Feb 2021 when it came to 
these claims? N 
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From: fb.com> 


Date: Friday, June 4, 2021 at 3:37 PM 


To: Nick Clegg §M@fb.com>, Joe! Kaplan fb.com> 
Bb .com>, EE fb .com>, fo.com>, 


TEC fb .com>, fb.com> 


Cc com>, 
Subject: Re: Wuhan lab leak theory 


tb.com> 


Yes, your original understanding is correct -- we only removed these claims starting in February ‘214 
(after MZ supported the decision}. We are going to revise the intro paragraph of the topper to state 
(edits in bold): 


On the question of our decision to remove claims related to the origin of COVID, we identified the 
claim that Covid is “man-made, manufactured, bioengineered, a bioweapon, or created by an 
individual government or country” as a claim that had been repeatedly labeled False by 3PFCs in May 
2020. That month, in order to leverage existing work from fact-checkers during a period when 
they were being overwhelmed by Covid-related misinformation, we decided that FB would 
claim-match for this claim, and four others that had been repeatedly debunked by 3PFCs, 
rather than requiring the 3PFCs to manually add their fact-checks to new instances of the claim 
being posted on FB & IG. Under the claim that Covid is “bioengineered,” we would have 
enforced on claims that the virus was modified through gain of function research and leaked 
from a lab. 


In February 2021, in response to continued public pressure and tense conversations with the new 
Administration, we decided we would remove the five Covid claims that had been repeatedly 
debunked by 3PFCs and the eight claims that we had identified (in partnership with WHO, CDC, and 
other public health authorities} before Covid as widely debunked vaccine misinformation. 


Last month, two of the 3PFCs that had rated the “man-made” claim false changed their original 
fact-checks. Politifact publicly rescinded its original fact-check. Factcheck.org updated its fact-check 
to acknowledge uncertainty and does not appear to have used it on FB content since the update. As 
this claim was no longer repeatedly fact-checked false, we removed it from our list of claims that we 
were removing. 


While we believe we made appropriate decision based on the information we had at the time, we also 
think this is ultimately a bad outcome, so we are working to revert all repeatedly fact-checked claims 
from a “remove” penalty to a “reduce & in‘orm” penalty. 


From: Nick Clegg Ga tb.com> 


Sent: Friday, June 4, 2021 6:09 PM 


To: @fb.com>; Joel Kaplan 
fb.com>; SNE fp.com>: 
fb.com> 


Subject: Re: Wuhan lab leak theory 


tb.com>: 


I'm now confused — apols, no doubt my failing - was the removal enforcement on these claims something which 
preceded our shift in Feb ‘21 or took place, as! had understood previously, after the Feb ‘21 decision as 
supported by MZ? 


N 
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From: fb.com> 


Date: Friday, June 4, 2021 at 3:02 PM 
fb.com>, Nick Clegg 
fb.com>, fb.com>, i 


To: Joel Kaplan SI p.com>, 
fb.com> 


fb.com> 


Subject: Re: Wuhan lab leak theory 


Yes, we would have removed the claim that the virus was modified through gain of function research 
and leaked from the lab. If gain of function was mentioned as a possible theory, as part of a broader 
discussion of the topic, we would have allowed it {as shown in the Fox News example in i: email). 


| would suggest that we revise | ® topper to include the following language in bold below: 


Mark: 


On the question of our decision to remove claims related to the origin of COVID, we identified the 
claim that Covid is “man-made, manufactured, bioengineered, a bioweapon, or created by an 
individual government or country” as a claim that had been repeatedly labeled False by 3PFCs in May 
2020. Ve did not enforce on the stand-alone claim that Covid was “studied in/came from/leaked from 
2 lab,” whicn has been a subject of debate from the early days of Covid. However, we would have 
enforced on claims that the virus was modified through gain of function research and leaked 
from a lab, which is one of the theories some people now are assuming may well have 
happened. Also in May 2020, in order to leverage existing work from fact-checkers during a period 
when they were being overwhelmed by Covid-related misinformation, we identified four claims (and 
later added a fifth) that had been repeatedly debunked by 3PFCs and decided that FB would 
claim-match for those claims rather than requiring the 3PFCs to manually add their fact-checks to 
new instances of the claim being posted on FB & IG. 


In February 2021, in response to continued public pressure and tense conversations with the new 
Administration, we decided we would remove the five Covid claims that had been repeatedly 
debunked by 3PFCs and the eight claims that we had identified (in partnership with WHO, CDC, and 
other public health authorities} before Covid as widely debunked vaccine misinformation. 


Last month, two of the 3PFCs that had rated the “man-made” claim false changed their original 
fact-checks. Politifact publicly rescinded its original fact-check. Factcheck.org updated its fact-check 
to acknowledge uncertainty and does not appear to have used it on FB content since the update. As 
this claim was no longer repeatedly fact-checked false, we removed it from our list of claims that we 
were removing. 


While we believe we made appropriate decision based on the information we had at the time, we also 
think this is ultimately a bac outcome, so we are working to revert all repeatedly fact-checked claims 
from a “remove” penalty to a “reduce & in‘orm” penalty. 


From: Joel Kaplan G2 f2.com> 
Sent: Friday, June 4, 2021 5:25 PM 
To: 


Mf. com> 
Subject: Re: Wuhan lab leak theory 
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Thanks. So to be clear, then, we would have removed an assertion that tracked closely with the current alternative 
theory (ie gain of function + lab leak)? If so, | think this is important to make clear in the email to Mark, because it 
means we would have removed the thing many people now are assuming may well have happened (and is distinct 
from the “Chinese military made it in a lab and intentionally released it as a bioweapon” variant of the claim, which 
is what the language from our rule might otherwise suggest was the case}. 


Get Outlook for iOS 


From: fb.com> 
Sent: Friday, June 4, 2021 5:19 PM 
To: Ni i : 

Ce: 


Subject: RE: Wuhan lab leak theory 


nd Biciven their familiarity with the details. The answer to Joel's questions is below. Nick— Mark 
approved the recommendation to remove widely debunked hoaxes (the 8 vaccines claims} and repeatedly fact 
checked claims (the 4 covid claims) on Feb. 1 after some back and forth with me and el He asked us to revisit 
once we were through the intensity of the covid crisis. We'll follow up on your question about how much content 
was removed based on these claims. 


(Joel's question] Can you please clarify how we have treated the specific claim that the virus was modified via 
“gain of function” experiments and leaked from the Wuhan lab? Did this qualify as “man-made or bioengineered”? 
As avery specific example, on what basis was the Tucker Carlson video removed—which claim did that video 
make? 


We would have removed claims the COVID-1$ virus was actually modified via “gain of function” 
pecause it’s akin to saying the virus was “bioengineered.” Our goal was to enforce on categorical 
assertions the virus was man-made or bicengineered, while allowing content that discussed “gain of 
function” research and the possible lab leak as one among several general theories about Covid. For 
example, we allowed this Fox News investigative report from January 2027 into the origins of Covid. 
The host presented several pieces of evidence to advance the hypothesis that Covid, while originating 
from a bat virus, may have “gained function” through GSG-funded research at the Wuhan Institute for 
Virology and may have been accidentally leaked given reported safety risks. But he also 
acknowledged the natural origin theory. 


The Tucker Carlson video was originally labeled/demoted when it ran back in September 2020 
pecause Carlson endorsed the viewpoint of the Chinese virologist he interviewed, who claimed the 
virus was made in a lab as a statement of fact, as summarized by the video’s caption, “Chinese 
whistleblower to Tucker: this virus was made in a lab & | can prove it.” The virologist explains in the 
interview: “This virus actually is not from nature. It is a man made virus created in alab...” and goes 
on to argue the Chinese government intentionally created the virus. In February, the video was 
automatically deleted when the decision was made to remove COVID repeatedly fact-checked hoaxes. 
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From: Nick Clegg fb.com> 
Sent: Friday, June 4, 2021 1:05 PM 


To: Joel Kaplan ; ; E fb.com> 


Cc: i 2 >. com> 
Subject: Re: Wuhan lab leak theory 


Thx fi_- happy for you to share this with MZ when it's finalized, he’s anxious to understand the details. 
Two key things which woud be useful to ade to this draft: 


e Were Mark/Shery! informed/consulted on the shift to “remove” in Feb ’21? 
® How have we in practice erforced these removals, ie roughly how much content did we remove as a 
consequence? 


Thx! 


N 


From: Joel Kaplan — 
Date: Friday, June 4, 2027 at 11:49 AM 
To: fo.com>, Nick Clegg fb.com> | 

b.com> 
Cc: EE of com> 


Subject: Re: Wuhan lab leak theory 


Can you please clarify how we have treated the specific claim that the virus was modified via “gain of function” 
experiments and leaked from the Wuhan lab? Did this qualify as “mar-made or bioengineered’? As a very 
specific example, on what basis was the Tucker Carlson video removed—which claim did that video make? 
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From: © fb com> 


Date: Friday, June 4, 2021 at 2:38 PM 
To: Nick Clegg {Of com>, iS ‘> com>, ot com> 
Cc: Ef. com>, Joel Kaplan Seth com> 


Subject: RE: Wuhan lab leak theory 


HZ A full timeline is below, and we've drafted a topper for Mark if helpful (let me know if you'd like me to send 
to him}. 


Mark: 


On the question of our decision to remove claims related to the origin of COVID, we identified the claim that Covid 
is “man-made, manufactured, bioengineered, a bioweapon, or created by an individual government or country” as 
a claim that had been repeatedly labeled False by 3PFCs in May 2020. We did not enforce on stand-alone claim 
that Covid was “studied in‘came from/leaked from a lab,” which has been a subject of debate from the early days 
of Covid. Also in May 2020, in order to leverage existing work from fact-checkers during a period when they were 
being overwhelmed by Covid-related misinformation, we identified four claims (and later added a fifth) that had 
peen repeatedly debunked by 3PFCs and decided that FB would claim-match for those claims rather than requiring 
the 3PFCs to manually add their fact-checks to new instances of the claim being posted on FB & IG. 


In February 2021, in response to continued public pressure and tense conversations with the new Administration, 
we decided we would remove the five Covic claims that had been repeatedly debunked by 3PFCs and the eight 
claims that we had identified (in partnership with WHO, CDC, and other public health authorities} before Covid as 
widely debunked vaccine misinformation. 


Last month, two of the 3PFCs that had rated the “mar+made” claim false changed their original fact-checks. 
Politifact publicly rescinded its original fact-check. Factcheck.org updated its fact-check to acknowledge 
uncertainty and does not appear to have used it on FB content since the update. As this claim was no longer 
repeatedly fact-checked false, we removed it from our list of claims that we were removing. 


While we believe we made appropriate decision based on the information we had at the time, we also think this Is 
ultimately a bad outcome, so we are working to revert all repeatedly fact-checked claims from a “remove” penalty 
to a “reduce & inform” penalty. 


*Covid is man-made” claim timeline 
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January 2020: Speculation begins as early as January 2020 that Covid could have leaked from a 
Wuhan lab. However, health experts largely rejected the possibility that COVID-19 was man-made or 
pioengineered, given the close genetic resemblance to bat coronaviruses, similar experience with 
other pathogens, and the absence of other countervailing evidence. (See detailed Washington Post 
timeline for more.} 


e January 30, 2020: First Newsroom Post where we announce we are starting “to remove content with false 
claims or conspiracy theories that have been flagged by leading global health organizations and local health 
authorities that could cause harm to people who believe them.” 


Spring 2020: Claims about the virus being man-made begin circulating on Facebook, and several 
U.S. 3PFCs rate content making these claims as False. 


« March 25, 2020: Nick Clegg’s NRF where he states, on origin claims: “For claims that don't directly result in 
physical harm, like conspiracy theories about the origin of the virus, we continue to work with our network of 
over 55 fact-checking partners covering over 45 languages to debunk these claims.” 

e April 16, 2020: Bea - NRP announcing Correct the Record and adding COVID-19 fact checks to the 
COVID-19 Info Hub 


May 2020: Facebook starts labeling and demoting claims Covid is “man-made, manufactured, 
dDioengineered, a bioweapon, or created by an individual, government or country,” but excluded claims 
that it was “studied in/came from/leaked from a lab without specifically calling it man-made,” given the 
oossibility that it had accidentally leaked from the Wuhan lad had been less clearly debunked. This 
was in addition to starting to label and demote several other “repeatedly fact-checked hoaxes” {RFH} 
about Covid that were unlikely to change or become true (detail below). We did this as a way to slow 
the spread of the most common COVID-13 related hoaxes by reducing distribution and applying 
warning labels on posts that repeat claims several fact-checkers have already debunked. This 
allowed fact-checkers to focus their time and journalistic expertise debunking net new claims. 


February 2021: As part of an overall effort to remove as much COVID-19 and vaccine-related 
misinformation from our platform as possible, we decided to remove COVID RFHs and Vaccine 
WDHs. 


¢ February 8, 2021: Q§INRP announcing this expansion: “Today, we are expanding our efforts to 
remove false claims on Facebook and Instagram about COVID-19, COVID-19 vaccines and vaccines in 
general during the pandemic. Since December, we've removed false claims about COVID-19 vaccines that 
have been debunked by public health experts. Today, following consultations with leading health 
organizations, including the World Health Organization (WHO), we are expanding the list of false claims we 
will remove to include additional debunked claims about the coronavirus and vaccines. This includes claims 
such as: 
o COVID-19 is man-made or manufactured 
o Vaccines are not effective at preventing the disease they are meant to protect against 
° It’s safer to get the disease than to get the vaccine 
o Vaccines are toxic, dangerous or cause autism. 
e¢ “These new policies will help us continue to take aggressive action against misinformation about COVID-19 
and vaccines” 


May 2021: We stopped taking any FB enforcement action on the claim Covid is man-made given the 
renewed debate on the topic, indicating the issue is no longer settled. Two of our 3PFCs (Politifact 
and FactCheck.org} had amended their False rating of claim, though fact-checkers retain discretion to 
rate specific content making this claim. (We've seen at least one example of a 3PFC changing their 
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rating on specific content from False to Missing Context. ) 


© May 26, 2021: NRP deprecating the COVID is man made claim “In light of ongoing investigations into the 
origin of COVID-19 and in consultation with public health experts, we will no longer remove the claim that 
COVID-19 is mar-made or manufactured from our apps. We're continuing to work with health experts to 
keep pace with the evolving nature of the pandemic and regularly update our policies as new facts and 
trends emerge.” 


June 2021 TBD: Misinfo Policy to tee up recommendation to revert to reduce + label enforcement for 
Covid RFH claims, consistent with our codified principles for removing the most severely harmful 
misinformation vs. reducing + labeling other misinformation. 


Original List of RFH Claims 


Claims that the new coronavirus/SARS-CoVv-2;COVID-19: 


1. is man-made, including any of the following: 
a. Claims that it was manvfactured / bioengineered 
b. Claims that it is a bioweapon 
c. Claims that it was created by an individual, government, or country excluding: 


claims that it was studied in/came from/leaked from a lab without specifically calling it man-made. 
2. is or has been patented, including: 
a. by any specific person or entity. 
3. was predicted, specifically: 
a. In “Event 201"’s pandemic exercise in October 2019 OR 
b. in “Event 201s pandemic simulation in October 2019 
c. excluding: 


discussing the October 2019 exercise/simulation without explicitly claiming it predicted the new 
coronavirus outbreak 


claims about other possible predictions 
4. is not new, specifically: 
a. as proven by the existence of animal vaccines for coronavirus OR 


b. as proven by disinfectant product labels 


Claims about the role of masks in preventing the spread of COVID-19: 
5. Health authorities like the WHO/CDC do not recommend that healthy people wear masks. 


From: Nick Clegg BB 0. com> 
Sent: Thursday, June 3, 2021 1:46 PM 


To: fb.com>; m> 
Ce: fb.com>:; Joel Kaplan fb.com> 


Subject: Re: Wuhan lab leak theory 
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yes | think that’s a fair point going forward — ard def where Mark's head is — but for now plse we need to give him 
a satisfactory response to his query. N 


Fron: ES fb. com> 


Date: Thursday, June 3, 2021 at 1:25 PM 


To: fb.com> 
Cc: Nick Clegg (>. com> RT 363. com>, Joel Kaplan 


fb.com> 
Subject: Re: Wuhan lab leak theory 


| would love if we can leverage this case in the future as a reason to not deviate from our rule of only removing for 
safety reasons or vote suppression. We get pressured into these decisions in the moment — it often doesn’t pan 
out well, and the more we can resist, the better 


We have said for years that we think our role in non-safety risk cases of misinformation is to point people to 
accurate info and help inform discourse. If that's so, the number of times something has been rated false should 
not be a factor in deciding when we remove something. 


Sent from my iPhone 


On Jun 3, 2021, at 4:16 PM, fb.com> wrote: 


Multiple fact checkers rated the claim that the virus was man-made as false. At some point last year, we decided 
that, for a small number of claims that had been rated false repeatedly by fact checkers (“RFH claims’), we would 
claim-match these fact checks because the fact checkers were totally overwhelmed and had no capacity to 
leverage old fact checks plus deal with the new rumors/falsehoods spreading about covid. In February (I think} of 
this year, in response to public and political pressure to do more (capped by internal pressure to respond fo the 
external pressure), we decided that we would remove the RFH claims. 


From: Nick Clegg fb.com> 
Sent: Thursday, June 3, 2021 1:13 PM 


To: fb.com>; Ss fo.com> 
ce fb.com>; Joel Kaplan {B@tb.com> 


Subject: Re: Wuhan lab leak theory 


Assume we have something | can share with Mark now which explained our reason at the time we decided to 
remove claims re human origins of the virus? 


From: SE 0%), com> 


Date: Thursday, June 3, 2021 at 1:11 PM 
To: Nick Clegg 


fo.com>| fb.com> 
Ce: fb.com>, fb.com> 


Subject: RE: Wuhan lab leak theory 


I've asked the team to put together a short summary of what happened, but with the change in Trump timing I'm not 
sure |'ll be able to dig in until tomorrow post-10am. We'll get it fo you as quickly as possible after that though! 


From: Nick Cleag fb.com> 
Sent: Thursday, June 3, 2021 1:07 PM 


To: Mfb.cam>; fb.cam> 
Ce: fb.com>: fb.com> 


Subject: Wuhan lab leak theory 
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| i (atsé‘*d Mark is asking what the rationale was in the first place for us to remove the Wuhan lab leak theory, 
before the change we announced last week? He’s keen to know asap — and feels that this issue raises significant 
questions about our wider misinfo stance. Grateful for a short summary reply asap. Thx. N 
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Exhibit 47 


Internal Facebook email 
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From: Nick Clegg </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
Y DIBOHF23 T)/CN=RECIPIENTS/CN=NCLEGGE6E> 


To: 

Cc: Joe! Kapa), 
SS 

Sent: 6/12/2021 2:52:06 PM 

Subject: Re: Bi-weekly Covid report 


No, we'd need to delete the section I'd asked about earlier on in this thread. Thx. N 
Get Outlook for iOS 


From: > fb.com> 


Sent: Saturday, June 12, 2021 1:56:00 PM 
To: fb.com>:; Nick Cle 
Cc: Joel Kaplan 


M2 fb.com> 
Subject: Re: Bi-weekly Covid report 


Agree with that approach—would that mean sending the report as it was originally sent yesterday? 


Get Outlook for iOS 


From: Dfb.com> 
Sent: Saturday, June 12, 2021 3:04:34 PM 

To: Nick Clegg 
Cc: Joel Kaplan 


Subject: Re: Bi-weekly Covid report 


Nick, 
That proposal makes sense to me as long as others don’t see issues with that. 


I'll give folks a chance to chime in on that, but probably we can just omit discussion of those posts. 


On Jun 12, 2021, at 2:27 PM, Nick Clegg Be com wrote: 


ro 


Thx thx team — yes that makes sense to me. But — to be clear — given that (if with hindsight) these posts 
should not have been demoted in the first place (all of them seem v measured and appropriately caveated) and we 
are now reversing the demotions, | don't think we need to provide a running commentary in the report to Vivek ie 
we can provide the data on the posts without having to elaborate on demotion + reversal. Ok? N 


Date: Saturday, June 12, at 10:15 AM 
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fb corr, I ertS.com=, Nick Clegg 


To: Joel Kaplan 
fb.com>, 


fb.com>, 


Subject: Re: Bi-weekly Covid report 


Hi Joel, 


a 2: | just discussed, and we think it would be best to update the policy guidance under this prong of the 
policy (about “shocking” stories that can be true) for stories about the Pfizer-heart condition link, at least for the 
time being. The update would result in a narrower set of articles being subject to demotion, and the three articles 
below would no longer be demoted. 


Previously, the guidance had been that headlines needed to provide context about the /ack of seventy of the heart 
condition to avoid demotion. Providing context on the sma/! number of cases was considered tangential to 
whether the heart condition is a severe adverse event. However, we propose updating the guidance such that: (1) 
providing context about the small number of instances where this occurred also constitutes sufficient context to not 
be deemed “shocking’—so headlines with that context would not be demoted—and (2) we will be more 
conservative in thinking through edge cases so that we are not demoting any articles where there seems to be a 
good-faith effort by the publisher to not shock people as opposed to simply reporting the news around a sensitive 
event (in other words, it would need to be close to clickbait to demote). 


If you and others think this adjustment makes sense we will update the policy guidance and revise the report in 
accordance with the fact that these articles would no longer be demoted. We can also work with Ops to reverse 
these demotions if you are aligned with this plan, but please let us know if you want that reversal to take place 
before the report goes to the White House. 


Thank you. 


From: Joel Kaplan fb.com> 
Date: Saturday, June 12, 2021 at 12:33 PM 


een: com>, Nick Clegg [C'».com> a 


fb.com>, 


Subject: Re: Bi-weekly Covid report 
Or rather, CDC. 


Get Outlook for iOS 


From: Joel Kaplan Eo fb.com> 


Sent: Saturday, June 12, 2021 12:20:10 PM 
Mi  tit«éi la com>; Nick Clegg 4 i. com>; fb.com> 
fo. com>; IG fb.com>; fb.com>; Ti 


fb.com>: 
GE @ fb.com>: 


@fb.com> 


Subject: Re: Bi-weekly Covid report 
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Are we demoting other links like these? Given the FDA is having an emergency meeting on this subject, | am very 
nervous if we are demoting these articles. These articles don’t seem to lack context. 


Get Outlook for iOS 


From: fb.com> 
Sent: Saturday, June 12, 2021 12:13 PM 
To: Joel Kaplan; Nick Clegg; II 
Ce: 
Subject: Re: Bi-weekly Covid report 


Hi Joel, here are the 3 heart condition links (and the report edits will be coming shortly): 
- https:/Awww.facebook.com/newsmax/posts/10158237853967377 

- https:/Awww.facebook.com/nytimes/posts/10152690136754999 

- https:/Avwww.facebook.com/ABC7/posts/10158423967592452 


From: Joel Kaplan GE ob. com> 


Date: Saturday, June 12, 2021 at 1:39 AM 


To: Nick Clegg (a fb.com>, 


Cc 


@fb.com>, 


Subject: Re: Bi-weekly Covid report 
Can you pls share which were the three links that were demoted on this basis? 


Get Outlook for iOS 


Sent: Saturday, June 12, 2021 12:25 AM 
| 


Cc: 


Subject: Re: Bi-weekly Covid report 


Ok | — think! — | understand that: so we labeled/demoted because of a lack of context. 


Could we add this explanation plse to the text that I'm sending to Vivek? After the toing and froing re the “Wuhan 
Lab” content, I'm keen we remain alert to over rotating on content which may turn out to be true, and that we’re 
correspondingly precise about the reasons we put out for our enforcement actions. It’s late Fri night so obv this 
can wait till trrw. 


Thx 


N 


From: ES f>.com> 
Date: Friday, June 11, 2021 at 7:44 PM 


To: Nick Clegg {J @fb.com> 
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Cc: 


fb.com>, Joel Kaplan ; 


eo f>.com>, 


Mf .com> 


Subject: Re: Bi-weekly Covid report 


Adding others here (thanks toll and Ifor jumping in tonight)— 


These demotions flow from leadership’s recent break-glass decision to demote Tier 2 content manually when it 
appears in the highest-viral content that makes it to these Top N queues. This kind of story, in some cases, is a 
match for our “shocking stories” guidelines: “Shocking Stories: Potentially or actually true events or facts that can 
raise safety concerns, indicated by sharing the following either without context or with hyperbolic terms .... 
[including] content citing news articles about individuals experiencing adverse events after receiving a vaccine.” 
That was the case here. As the stories first started coming in, some described the condition as ‘mild’ or otherwise 
provided context about the severity of the risk. WWe gave guidance that where the on-platform content (which is all 
we assess) gave some context about the severity of the risk, links should not be demoted; however, because a 
heart condition is a potentially severe adverse event, without some context about the mildness in the on-platform 
content, the policy calls for demotion. 


For more context, this situation was one of the main reasons we originally did not demote Tier 2 content. To try 
and avoid this situation when we transition to automated enforcement of this policy, we plan to exclude news 
publishers, in part because we're not asking reviewers/classifiers to make credibility or truth/falsity assessments in 
addressing this content, we are only evaluating whether stories that raise safety concerns are being shared without 
sufficientany context. 


Get Outlook for iOS 


From: Nick Clegg GO fb.com> 

Sent: Friday, June 11, 2021 9:16:54 PM 

To: fb.com> 

_ aS [>.con> ES fb.con>; TS sb com>; Ii 
Kaplan <joelkaplan@fb.com>; EG fb.com> 


Subject: Re: Bi-weekly Covid report 


Thanks H- before | send to Vivek can | just check on this assertion: 


1. Three posts were news articles about a potential link between the COVID vaccine and a heart condition in young males. Our systems did not 
automatically demote these four pieces of content but on further review they were demoted and a safety label was added. 
| have read a number of mainstream press reports of the suspected link between the Pfizer vaccine and higher 
than normal levels of heart infection amongst young males — | assume from authoritative sources. VVhy did we 
label/demote this? 


Thx 

N 

From: fb.com> 
Date: Friday, June 11, 2021 at 4:13 PM 
To: Nick Clegg fb.com> 


Subject: Bi-weekly Covid report 


Nick, 
Attached is our bi-weekly report to share with Vivek Murthy today. Flagging a few issues for your visibility, but we 
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don't think necessary for you to call out in an email to Vivek (as these are explained within the report). 

e The report contains 8 pieces of “Barriers to Vaccination" content (1 in the week of 5/22 and 7 in the week of 
5/29) which were eligible for demotion but were incorrectly not demoted at the time in order to reduce their 
distribution. The majority of these errors were human enforcement errors and our current assessment is that 
the level of errors we're seeing seems in line with the difficulty of applying the policy to diverse and nuanced 
content. We're largely seeing misses that we think are reasonable to make, and/or reflect the nature of the 
context rapidly changing in the Covid environment (for example - this week, we have seen a number of 
questions from reviewers about things like “does a new spate of heart conditions reporting count as BV?" 
and are going back to retroactively apply guidance). 

The report also includes one piece of content posted by Candice Owens that was ultimately removed under 
our misinfo and harm policy but that managed to reach #11 of our top 100 vaccine content before removal. 
The timeline: content was posted at 8:30am on May 25, and within 30 minutes it was identified and demoted 
by HERO (our Al virality monitoring system), and was correctly escalated to CO-Presc for review under our 
Covid-19 M&H policies. It was then escalated by misinfo policy and was removed 7 hours later for Covid 
M&H, but in the meantime it went to #11 of our top vaccine content. 

If comfortable—I'd recommend you send to Vivek with a simple cover email that suggests you and the team are 
available to discuss any questions or concems. 
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Message 


From: ® §).<or| 

Sent: 6/12/2021 9:43:01 PM 

To: a 

Subject: Fwd: Facebook bi-weekly covid content report 


Attachments: 6 _11- COVID-19 Insights.pdf 


Making sure this gets to you—look forward to connecting this week. 

Get Outlook for 10S 

From: Nick Clegg or 

Sent: Saturday, June 12, 2021 9:28:58 PM 

To: Murthy, Vivek {HHS/OASH} < hhs.gov> 

Ce: Slavitt, Andrew M. EOP/WHO who.eop.gov>; Rf .com> 
Subject: Facebook bi-weekly covid content report 

Dear Vivek 


As promised/discussed, the latest Facebook bi-weekly covid content report attached. As always, I’m happy to jump ona 
call at any point - as is my team — to delve into any details further as needed. 


All best 


Nick 
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From: WR «/0= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob R. EOP/WHO 
Sent: 7/12/2021 2:17:20 PM 
Subject: Re: [EXTERNAL] FW: Facebook Cowd report 


let me check—will be back. 


From: Flaherty, Rob R. EOP/WHO EE 0 v110.e00.gov> 


Date: Monday, July 12, 2021 at 7:38 AM 
To: fb.com> 
Subject: Re: [EXTERNAL] FW: Facebook Covid report 


In looking at this data — of the top 100 posts, is it possible to pull out the ones you're putting in the knowledge 
panels (whatever you're calling them}? Like, which ones are appearing natively in feed versus the ones (like unicef) 
that aren’t? 


Sent from my iPhone 


On Jul 11, 2021, at 11:27 PM, Brian Rice <brianrice@fb.com> wrote: 


Making sure you received—hope all is well. 


From: Nick Clegg < fb.com> 
Date: Saturday, July 10, 2021 at 3 
To: Murthy, Vivex (HHS/OASH} 
Ce: Slavitt, Andrew M. EOP/WHO < @who.eop.gov>, @fb.com> 
Subject: Re: Facebook Covid report 


Dear Vivek 

Attached is the latest Covid report covering the most recent two week period for which we have stats etc. | 
understand from Brian that my team is meeting with yours next week to delve deeper into our covid misinformation 
efforts. As always, please don’t hesitate to reach out when/if needed. 


All best 


Nick 


From: Nick Cleag fb.com> 

Date: Friday, June 25, 2021 at 11:19 PM 

To: "Murthy, Vivek (HHS/OASH)" < hhs.gov> 

Ce: "Slavitt, Andrew M. EOP/WHO" who.eop.gov>, 
< fb.com> 

Subject: Facebook Covid report 


Dear Vivek. 


Attached is the latest Covid report covering the past two weeks. As always. happy to answer any questions vou might have with 
respect to the report's contents. 
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Additionally. I want to highlight two vaceine-related efforts that launched this week: 
The first is the \Wbats App chat bot we launched with the CDC. This Spanish-language bot not only surfaees local vaecine 
appointinents, it also links users with free Uber’Lyfi rides to their appointments and childeare availability nearby, We're excited by 
the impact this will have on the LatinX vaccination rate, 


Second. I wanted to share that we launched a notification to every Instagram user in the United States cneouraging them toe visit 
vaccines.gov, Afler months of state-specific notifications to IG’s +130M users in the US. this is Instagram’s first push to 
vaccines. gov, Based on the demographics of Instagram. were looking forward to reaching the nation’s vouth and to having a 
posilive impact on their vaccination rates. 


Thanks and please don't hesitate to reach out. 


<7_8 - COVID-19 Insights. pdf> 
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From: Waldo, Eric (HHS/OASH) <I nhs. gov> 
To: P| 

cc: 

Sent: 7/23/2021 5:34:48 AM 

Subject: RE: Connecting with Dr. Murthy's office 


‘ 


Thanks so much for your note. | believe my colleague got back to one of your colleagues last 
night, but in addition to Dr. Murthy, | will be on the call as will 

Thanks so much, 

Eric 

From: ofb.com> 


Sent: Thursday, July 22, 2021 3:55 PM 
To: Waldo, Eric {HHS/OASH) < @hs.gov> 


Ce: usdigitalresponse.org>; I @ fb.com> 
Subject: Re: Connecting with Dr. Murthy's office 
Hi Eric, 


| hope all is well. 
The team wanted to follow up to ask who will be joining the meeting tomorrow with Dr. Murthy? 


Best, 


From: fb.com> 

Date: Thursday, July 15, 2021 at 10:10 AM 

To: “Waldo, Eric (HHS/OASH)" <M @nhs. gov>, Nick Clegg <@fb.com>, =e 
< fb.com> 
Ce: @usdigitalresponse.org> 


Subject: Re: Connecting with Dr. Murthy's office 


Thank you very much Eric, 
We did see the announcement and thank you for following up with us. 


VWWe will connect more tomorrow. 


Best, 


From: "Waldo, Eric (HHS/OASH)" <{iii@nhs.gov> 


Date: Thursday, July 15, 2021 at 9:08 AM 


Ce: @ usdic italresponse.ore 
Subject: RE: Connecting with Dr. Murthy's office 
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You've probably seen this, but sharing here: 


“Heaith misinformation is an urgent threat to public heaith. it can cause confusion, sow mistrust, and 
undermine public heaith efforts, including our ongoing work to end the COVID-19 

pandemic,” said U.S. Surgeon General Dr. Vivek Murthy. “As Surgeon General, my job is to heip people 
stay safe and healthy, and without limiting the spread of health misinformation, Amencan lives are at risk. 
From the tech and social media companies who must do more to adaress the spread on their platforms. to 
all of us identifying and avoiding sharing misinformation, tackling this challenge will require an all-of- 
society approach, but it is critical for the long-term health of our nation.” 


You can learn more and access the full advisory here. 


From: Waldo, Eric {HHS/OASH) 
Sent: Wednesday, July 14, 2021 8:50 PM 


To: fb.com>; Nick Clegg <i fh. com>; ME o tb com> 
Ce: usdicitalresoonse.org> 


Subject: RE: Connecting with Dr. Murthy's office 


Thanks so much, 


| don't think there will be too many surprises, but eager to share the whole thing and dig in this week. On the 
technology side, at a high level, the Advisory notes that technology companies and social media organizations 
nave a role to play in product and policy design to help slow the spread of health misinformation. Again, | knew you 
nave all been working hard and thinking deeply about this issue. 


Looking forward to comnecting Friday. 


Best, 
Eric 


From: Ofb.com> 
Sent: Wednesday, July 14, 2021 5:57 PM 


To: Waldo, Eric (HHS/OASH) <§EEEoths.gov>, Nick Clegg <ffarb.com>, j—————s3] 


< fob.com> 
Ce: busdigitalresponse.org> 


Subject: Re: Connecting with Dr. Murthy's office 


Thank you very much Eric and looking forward to speaking to you on Friday. 
| understand you are waiting for the public announcement, but do let us know if there is a social media aspect you 
can provide insight on. 


Best, 


| 
From: "Waldo, Eric (HHS/OASH)" <E@hhs. cov> 


Date: Wednesday, July 14, 2021 at 5:21 PM 


To: Nick Cle fo.com>, fo.com>, 22. com> 


Ce: Q@usdigitalresponse.org> 
Subject: RE: Connecting with Dr. Murthy's office 


Hi Nick, i anc 
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| hope this finds you all doing well this week. (JH! know we are slated to connect on Friday, but wanted to 
loop before then with all of you] 


| Know we had hoped to connect earlier, but | did want to just give you a quick heads up (close hold} that Dr. Murthy 
will be releasing an Advisory tomorrow about the importance of addressing health misinformation. | can share the 
doc tomorrow once it’s public, but it’s a first step for us to call for a whole-of-society approach to addressing this 
important topic. | know there will be a chance for us to connect Friday and beyond about this and more, but wanted 
to give you all a courtesy heads up. 


Looking forward to connecting. 


Best, 
Eric 


Eric WV. Waldo [He/Him] 

Director of Engagement 

Office of the U.S. Surgeon General, Dr. Vivek Murthy 
U.S. Department of Health & Human Services 


From: Waldo, Eric (HHS/OASH) 
Sent: Tuesday, July 6, 2021 9:47 AM 
To: fb.com:; fb.com 
Ce: usdigitalresponse.org> 
Subject: Connecting with Dr. Murthy's office 


Hi Nick and I 


| hope this finds you well. |'m Dr. Murthy’s Director of Engagement and | wanted to reach out. 


As you know, one of the issues Dr. Murthy has been thinking adout is now to help stop the spread of health 
misinformation as we continue to tackle COVID1$ and beyond. | know you and your teams are working hard and 
thinking deeply about this issue. We'd love to chat over zoom to connect and discuss what's on the horizon for our 
teams. 


Is there a good time this week to connect? Happy to work with whomever on your team to coordinate calendars. 


Thanks so much! 
Eric 


Eric W. Waldo [He/Him] 

Director of Engagement 

Office of the U.S. Surgeon General, Dr. Vivek Murthy 
U.S. Department of Health & Human Services 
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From: /O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF 23SPDLT)/CN=RECIPIENTS/CN= {oii 3 > 


To: Tom, Christian L. EOP/WHO 

cc: Flaherty, Rob R. EOP/WHO; O'Neil, Tegan £. EOP/WHO; KG); Qureshi, Hoor A. 
EOP/WHO 

Sent: 8/2/2021 5:11:33 PM 

Subject: Re: Follow up on WH questions 

Happy to. 


Hoor, could you surface some times that work for your folks and we can go from there? 


facebook. inc. | politics & government 


EE 2 con 


On Aug 2, 2021, at 6:04 PM, Tom, Christian L. EOP/WHO - Gas gov> wrote: 


Thanks for the info. A call might be helpful, if we can do something early next week? Adding Hoor here but 
appreciate your email and making time to talk further about it! 


From: fb.com> 
Sent: Monday, August 2, 2021 1:14. PM 


To: Tom, Christian L. FOP/WHO <I win. eop gov>; Flaherty, Rob R. EOP/WHO 
who.eop.gov>; O'Neill, Tegan E. EOP/WHO SEI 20 200 cov>- 


(IG) < fb.com> 
Subject: [EXTERNAL] FW: Follow up on WH questions 


Hi All, 


Per my and Christian’s phone call last Tuesday, | gathered more details for you and your team; happy te set upa 
Call to discuss further as well. 


As you know, we take aggressive steps to reduce the spread of vaccine hesitancy and vaccine misinformation on 
our platforms and we deploy technology to do so. As part of our efforts on Instagram, we have measures to help 
ensure we don't recommend people follow accounts that promote vaccine hesitancy at scale. For two weeks in 
April (April 14-28) this measure was impacted by over-enforcement on a signal we used -- accounts that were 
posting far above normal vaccine-related content -- and removed these otherwise eligible accounts from being 
recommended as an account to follow. This did not impact reach or distribution of content in Feed or Stories or 
other areas of account discovery on Instagram, such as search or Explore. 


Per your request for remediation, while we camot boost your account In our recommendations, we are always 
nere to help with content strategy, best practices, and further opportunities to collaborate. 


Again, happy fo discuss further on a call. 


Best 
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From: i! (C) ofp com> 


Date: Thursday, July 15, 2021 at 4:06 PM 


To: Flaherty, Rob R. EOP/WHO _ 2 O'Neill, Tegan E. EOP/WHO 
BEE 1 0.020.c0-, 


‘o® o> 
Subject: Re: Follow up on WH questions 


Hi Rob — | totally understand how frustrating that is. This was due to a bug in our recommendation surface, and 
was resolved in late May. Accounis affected did not specifically lose any followers as a result, nor was their 
presence reduced in Search or Explore, however. If you want to hop on the phone to discuss it, |’m at 

nytime. 


From: "Flaherty, Rob R. EOPAWHO" 
Date: Thursday, July 15, 2021 at 3:29 PM 
To: "O'Neill, Tegan E. EO 7 J 
< @fb.com>, 
Subject: RE: Follow up on WH questions 


who.€op.gov> 


who.eop.gov>, kil IG)" 


fb.com> 


Are you guys fucking serious? | want an answer on what happened here and | want It today. 


From: O'Neil, Tegan E. EOP/WHO 
Sent: Thursday, July 15, 2021 3:29 PM 


To: IG) < fb.com>; I 6 ¢.com>: Flaherty, Rob R. 


EOPAWHO < 10.eOp.gov> 
Subject: RE: Follow up on WH questions 


++ @Flaherty. Rob R. EOP/WHO 


From: (C) <I ‘b.com> 
Sent: Thursday, July 15, 2021 3:20. PM 


To: ONeil, Tegan €. EOP WHO <EEE wi eo 01>; IIE ,cor> 


Subject: [EXTERNAL] Re: Follow up on WH questions 


Hi Tegan — from what we understand it was aninternal technical issue that we can’t get into, but it’s now resolved 
and should not happen again. 


From: "O'Neill, Tegan E. EOP/WHO" 
Date: Thursday, July 15, 2021 at 2:28 PM 


Subject: RE: Follow up on WH questions 


who.eop.gov> 


Thanks = 
Could you tell me more about the technical issues affecting audience growth? Vas this just us and do you have a 
sense of what the issue was? 


From i () <6 'b.2om> 
Sent: Thursday, July 15, 2021 2:27 PM 


To: O'Neil, Tegan E. EOP/WHO <{EElowno cop. gov>: EM o'b. com> 
Subject: [EXTERNAL] Follow up on WH questions 
Hi again Tegan! 


Coming back here on a few things: 
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-First, the technical issues that had been affecting follower growth on @potus have been resolved. Though there is 
stil the issue of bot accounts being removed as normal, you should start to see your numbers trend back upwards, 
all things being equal and notwithstanding the big spike you saw this week given the collaboration with Olivia 
Rodrigo. Thanks for your patience as we investigated this. 


-The answers to your aspect ratio, video quality and thumbnail questions can all be found in our Help Center here: 
>>>https:/wwwfacebook.com/nelp/instagram/381435875695118<<<:; and inthe links on that page. Regarding 1:1 
or 4:5 for feed video, | don't have any specific recommendations on it, Obviously we know social managers are 
Dusy creating video for multiple platforms, so rest assured there is no algorithmic downside to using one crop over 
another. 


-Finaly, | can't release any numbers related to ‘he performance of difference video formats, or light mode vs. dark 
mode usage unfortunately. 


—_ know if you have any outstanding questions on these. 


From: "O'Neill, Tegan E. EOP/WHO" EE o2 <0 20 
Date: Tuesday, July 13, 2021 at 11:42 


Subject: RE: IG optimization questions 


Appreciate it! 


From: iS) Ee» <0 
Sent: Tuesday, July 13, 202 : 


To: O'Neil, Tegan E. EOP/WHO <{jowno cop cov> BB com> 


Subject: [EXTERNAL] Re: IG optimization questions 


Hi Teagan! Let me round up some answers to these questions and come back to you shortly. Attached is the last 
edition of our IGTV video specs for you to check out in the interim. 


-_ soon! 


From: "O'Neill, Tegan E. EOP/WHO" <I who. eop.gov> 
Date: Tuesday, July 13, 2021 at 10:15 AN 


Subject: IG optimization questions 


Hope youre both well! I’m updating specs and guidelines for our video tearn and had a few quick questions. 


e Do you have a guide/recommendation on codec/video quality? We've seen some issues with video files that 
display crisply on other platforms 

¢ Do you have an updated thumbnail guide for IGTV and reels? 

¢ Do you see any difference in performance between black, white, and branded video mattes on square 

videos in vertical placements? 

Do more people use night mode than day mode? 

For in-feed video (not sure what to call this but norn-IGTV, nor-reel video) do you recommend 1:1 or 4:5 

these days? 
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Thank you! 
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Exhibit 52 


Internal Facebook email 
correspondence 
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From: Nick Clegg </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=NCLEGGE6E> 


To: 

cc: 

Sent: 7/14/2021 11:46:33 AM 

Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 
thx 


Date: Wednesday, July 14, 2021 at 7:44 PM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Because we were under pressure from the administration and others to do more and it was part of the “more” 
package. We removed four claims that multiple fact checkers had labeled false even though we didn’t have a harm 
assessment. We shouldn't have done it. We stopped removing the man made claim inlay and now we're 
moving the other three claims (covid is new/patented) from remove to reduce and Yaform. 


From: Nick Clegg <J@fb.com> 
Sent: Wednesday, July 14.2021 11:41:56 AM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Can someone quickly remind me why we were removi ather than demoting/labeling — claims that Covid is man 
made before May? 


From: 21) com> 


Date: Wednesday, July 14, 2021 at 5:32 PM 


To: ES {b.com>, EE oor Bo cor 
a = fb.com>, JE 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Following up here (and replying on behalf of Justine as well who is presenting in another meeting): VWWe worked to 
further streamline and simplify the talking point around the 12 people identified by the CCDH (‘disinfo dozen’). 
We'd recommend using the following: 


"People on the Center for Countering Digital Hate's list show up in multiple places across Facebook products: 
Facebook pages, Facebook groups, and IG accounts for example. If they repeatedly break our rules, we 
permanently remove that page, group, or account from our services, and we've done that in more than a dozen 
instances." 


In case it's helpful for further context, the break-down of the entities we’ve removed associated with people 


CONFIDENTIAL TREATMENT REQUESTED 463 META-118HJC-0053384 
NOT FOR DISTRIBUTION 
MEMBERS & STAFF ONLY 


identified by the CCDH is: IG Profile = 9; FB Page = 4; FB Group = 1. 


From: Justine Isola <justineisola@fb.com> 
Date: Wednesday, July 14, 2021 at 8:04 AM 
To: Nick Clegg 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Yes, we have said that publicly. 


From: as baie ‘zz com> 


Date: Wi uly 14.2021 at 7:50 AM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Ok — got it (| think) — can | cite your bullet point in blue on this (“entirely removed... 2 a dozen” etc)? N 


From: Justine Isola <justineisola@fb.com> 
Date: Wednesday, July 14, 2021 at 3:42 PM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podc 


That is a good question. The “disinfo dozen” refer, Dy Many of those people have multiple presences 
C IG ac 


onFB/IG. For example, RFK Jr. had a FB Page a count. We have removed the |G account but not FB 
Page, as he posts different content across those t esences and only the IG account has reached our 
threshold for removal. 


From: Nick Clegg fb.com> 
Date: Wednesday, July 14, 2021 at 7:35 AM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Thx - now, for truly the most simplistic question...: if we’ve removed pages/accounts of a dozen individuals what's 
left on FB of the “disinfo dozen’? 


N 


Get Outlook for iOS 


From: SI 0 com> 
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Sent: Wednesday, July 14, 2021 3:29:38 PM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 


Thanks, Nick. See responses below in blue. 


From: Nick Clegg <{j@fb. com> 


Date: Wednesday, July 14, 2021 at 4:38 AM 


Subject: Re: Brief: 07.14.21 - Andy Slavitt Podcast 
Thx, Just a few Qs: 


e | don't understand the eg of “shedding” that we took action on? 

Vaccine shedding is the term used to describe the release or discharge of any 
in or outside of the body. We've seen people closing down their shops to peop 
vaccinated because of fears of shedding, to give just one example of how 
and could contribute to hesitancy. Vaccine shedding can only occur whag 4g 
version of the virus and occurs when a virus is released from an infected 
vaccines cause any kind of shedding. None include living Covid-19 so itis i 
people to shed Covid-19 from the vaccine itself 


of the vaccine components 
who have been 

1 iS Causing confusion 
aacine contains a weakened 
rson. None of the Covid-19 
npossible for vaccinated 


e The Q&A has Qs asking why we only took action on covid vaccine misinfo in Dec last year and Feb this 
year. Why these dates? 


December 2020 is when we first announced we yw 
vaccines given the news the vaccines would sc 
know what would be true or false about theg# 
remove general vaccine misinformation (@wic 


e | find what we've actually done re the “disinfo dozen” v hard to follow. Any way to simplify that for me? 


Center for Countering Hate’s (CDDH) Disinformation Dozen 

e We have removed violating content that these accounts have posted 

e We have entirely removed the Facebook Pages or Groups or Instagram accounts of more than a dozen of 
duals for repeatedly violating our misinformation policies. In other cases, we have restricted their 
activity (e.g. by not recommending their content) 


these indivi 


N 


From: EE > com> 
Date: Wednesday, July 14, 2021 at 7:17 AM 


To: Nick Clegg 
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Subject: Brief: 07.14.21 - Andy Slavitt Podcast 


Nick: Attached is an updated briefing for Wednesday’s podcast interview. It now includes an overarching narrative 
and specific content examples you can cite. Please let us know if you have additional questions — the folks on this 
email can help to track down additional info. 


Thanks, 
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Exhibit 53 


Text messages between Nick Clegg and 
Andy Slavitt 


467 


8:08 r a 


Andy > 


aboultkycon 


Good. | will take a look. | like the 
headline at least 


| don't think of this piece as very 
productive for what it's worth. It 
feels like marketing that talks 
around the problem. Instead of 
“what more could we do” which is 
how you move past finger pointing. 
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8:09 . Fr 


Andy : 


I've looked at some of the things the 
WH is seeing and | see why they‘re 
troubled. 7 of top 10 vaccine posts 
on FB are anti-vaxx. The top one is a 
lie— Candace's tweet that the 
government is hiding vaccine 
deaths. The “positive” tweets are 
boxed tweets. There are very easily 
identifyable posts. 


1 Reply 


1 @@200 
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Andy > 


They are promoted and highly 
viewed. The WH wants FB to come 
clean with how many people see 
these posts and what it’s doing 
about them. They believe they have 
asked and asked. 


By the way | don’t think a Facebook 
spokesperson saying the SG praised 
FB was a move likely to endear him 
to you. If you were him would it 
make you more or less likely to trust 
talking to you? 
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8:71 a er 


FB posts. Top 10 viewed. That's 
what they’re seeing. If | said tweets 
it was an error 


| want to really stay out of the 
middle and want you guys to 
communicate. Please have Brian ask 
for the data that concerns them the 
most and if they would share it. But 
don't indicate that I've tipped this. 
And I'm fuzzy on the methodology 
used in these caiculations. 


471 
CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0063033 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


Exhibit 54 


Internal Facebook email 
correspondence 
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From: I <0. = THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=8A703079191 54AFS9F82CFF2CE7AD656> 


To: MisinfoPolicyTeam 
Sent: 7/16/2021 8:14:12 PM 
Subject: Re: Biden Admin Health Misinfo Advisory 


| agree. This seems like a political battle that’s not fully grounded in facts, and it’s frustrating. That said, there’s 
good momentum internally right now to get even deeper on the data so we can push back more directly, so 
hopefully we'll have a bit more to say on this soon. 


From iS ©1.com> 
Date: Friday, July 16, 2021 at 7:32 PM 


To: fb.com>, MisinfoPolicyTeam <a ob. com> 


Subject: Re: Biden Admin Health Misinfo Advisory 


Thanks for sharing. There are so many untested assumptions in what the administration is saying recently—social 
media misinfo is increasing, it’s leading to death, it has animpact different from misinfo other places—not to 
mention how their definition of “misinfo” is completely unclear. As fair as it is to say we need to do better about 
reporting numbers that mean something, it also just seems like when the vaccination campaign isn't going as 
hoped, it’s convenient for them to blame us.... 


Get Outlook for iOS 


From: Eo 1).com> 
Sent: Friday, July 16, 2021 5:07:38 PM 

To: MisinfoPolicyTeam  o f).com> 

Subject: FW: Biden Admin Health Misinfo Advisory AC 


FYI 


From: fb.com> O 


Date: Friday, July 16, 2021 at 4:51 PM 
To: Nick Clegg 


, Joel Kaplan 


ie 


From: 
Date: Friday, July 16, 2021 at 4:33 PM 


gg fb.com>, fb.com>, Joel Kaplan 
i ee 


fb.com> 
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GB ib. com>, 


Subject: Re: Biden Admin Health Misinfo Advisory 


Follow up on the current state of this news cycle and a New York Times story that will publish shortly: 


At the White House press briefing today, Jen Psaki again repeated that the Biden administration is 
concerned with the level of misinformation spreading on Facebook (excerpts of her comments here). 
This was followed by President Biden making an on-camera comment that social media companies, 
like Facebook, “are killing people” with Covid misinformation. We've responded with a strong 
statement included below. 


News Cycle: Coverage regarding Biden’s comments is at a high volume. We've seen about 45 
articles mostly from top tier publications, and the story is leading across broadcast. Social 
conversation is also high with over 32k mentions on Twitter. 


Upcoming NYT article: Cecilia Kang and Zolan Kanno-Youngs at the.NewWYork Times will be 
publishing a story shortly that will include details about meetings betw us’and the White House. It 
will say that Facebook is not providing the administration with basrewpforntation and the administration 
is frustrated. Details will include that our conversations with th  reogaing Covid and vaccine started 
around December and there have been conversations betwg€n and Ron, Nick and Anita and 
meetings between rank-and-file team members with both the ite House and the Surgeon 
General's team. The story will highlight three specific examples: 

e Aconfrontational conversation where the White Goudy was asking why we would not share 
more data, specifically data that showed our effo Vere working. 

e The White House brought Crowdtangle data to Facebook that showed misinformation on 
vaccines was soaring. This data was dismissed by Facebook saying it was not accurate or 
reliable. 

e The Surgeon General left frustrated from a meeting where Facebook said it has hired 
influencers to spread authoritative information. Specific statements from the SG that working on 
offense does not address the problem of all the misinformation spreading on the platform in the 
first place. 


We spoke to Cecilia extensively on background to push back on inaccuracies in the claims above as 
well as provide more detailed information on our efforts and steps we've taken to address the White 

House’s concerns. We will follow up here with the story and more detailed readout on coverage later 
today. 


Statement: “We wi// not be distracted by accusations which aren't supported by the facts. The fact is 
that more than 2 billion people have viewed authoritative information about COVID-19 and vaccines on 
Facebook, which is more than any other place on the internet. More than 3.3 million Americans have 
also used our vaccine finder tool to find out where and how to get a vaccine. The facts show that 
Facebook is helping save lives. Period.” 


COVERAGE REPORT 
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From: fb. com> 
Date: Friday, July 16, 2021 at 10:30 AM 
To: Nick Clegg GEL %0 com>. 
fb.com> ib com>, 
fb.com>, fee Dib.com> 
Ce: @fb.com>, Ofb.com> 

GED) fb.com>, tb com>, @fb.com>, Sa 
Mfb.com>, @fb.com> @fb.com> 
@fb.com> TD.cOoMm>, 
@fb.com>, l@tb.com>, 

Kfb.com> @fb.com>, 
@fb.com> 

Subject: Re: Biden Admin Health Misinfo Advisory 


@fb.com>, Joel Kaplan 


@fb.com>, il 


@fb.com>, 


All, 


See below for a coverage update on yesterday's Biden administration advisory on health misinformation and 
subsequent criticism from the VWWH. Incoming and coverage has slowed though media interest and volume remains 
high. Key themes of the coverage now include 

1. GOP claims of censorship/collusion, following Psaki’s remark that the White House is flagging misinformation 
posts to Facebook, remain the hot story in conservative press today (and is now ing the most article headlines 
for the cycle). 2. A secondary narrative centers around the relationship/discuss! etween the White House and 
Facebook, which CNN is reporting as "tense" in recent weeks. 


In terms of our ongoing response, we are: 
e Continuing to work directly with reporters as questions conetag e record straight on what we have 
done and push back on inaccurate claims made by the VWWH. 
e Meeting with staff from the Surgeon General's office 
e Drafting a note for Nick to send directly to the Surgeo 
continue to partner with them 
e Monitoring the upcoming WH press briefing for any more developments here (just started) 
e Finally, Nick's interview with Andy Slavitt will come out next week and is a more nuanced and fair depiction of 
both what we’ve done and the challenges we face. We'll make sure to move that around to everyone who’s 
covered these comments. 


o discuss these issues (3pm ET) 
eral responding to criticisms and offering to 


Many thanks, 


TL;DR: Number ten on Techmeme, media interest surrounding Surgeon General Dr. Vivek Murthy and Press 
Secretary Jen Psaki’s comments yesterday on Covid misinformation remains high despite the pace of coverage 
slowing in recent hours. Two areas of media showing particular interest in the narrative on the second day of 
coverage: U.S. network and cable broadcast programs and right leaning publications. The spike in Covid cases is 
the lead story in U.S. press today—with the Surgeon General’s advisory, LA county reinstating its indoor mask 
policy and the rising cases in Tokyo ahead of the Olympics, bolstering the cycle. Additionally, GOP claims of 
censorship/collusion, following Psaki’s remark that the White House is flagging misinformation posts to 
Facebook, remains the hot story in conservative press today (and is now driving the most article headlines for 
the cycle) 


Another narrative to watch particularly closely as this cycle progresses (being pushed out by CNN), is the 
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accurate and Facebook needs to move more quickly to remove harmful, violative posts. Posts that will 
be within their policies for removal often remain up for days. That's too long. The information spreads 
too quickly. Finally, we have proposed they promote quality information sources in their feed 
algorithm. Facebook has repeatedly shown that they have the leverage to promote quality 
information. We have seen them effectively do this in their algorithm over low quality information, and 
they've chosen not to use it in this case. And that's certainly an area that would have an impact. So 
these are certainly the proposals. We engage with them regularly and they certainly understand 
what our asks are.” 


From: i 3 fb .com> 


Date: Thursday, July 15, 2021 at 4:21 PM 


Subject: FYI: Biden Admin Health Misinfo Advisory 


health misinformation. He joined the White House press briefing aS welkwhere he called for tech companies to take 
jon us by Name, White House Press Secretary Jen 

D misinformation and listed four steps the WH 
gi(see transcript below). 


‘ ) 
Today, Surgeon General Vivek Murthy issued an advisory calling bette -society approach to combating 


greater steps to combat misinformation. While he did not meq 
Psaki did criticize Facebook specifically for our handling of 
believes we should be taking, much of which we are already Ge 


Comms Strategy 
e We provided extensive background in 1:1 calls with press who reached out pushing back on the inaccuracies 
in some of Psaki’s comments including: 
o We continue to promote accurate and reliable information across both Facebook and Instagram on 
posts, in News Feed and in search. 
o We have taken substantial steps to limit COVID misinformation on our apps 
o We have removed multiple accounts related to the “Disinformation Dozen’ report from the CCDH 
e We also provided a straightforward statement highlighting our efforts. The response was designed to defend 
our actions without prolonging the news cycle. 


Coverage so far has been moderate with overall sentiment landing straightforward to negative and a majority of 
the articles are leading with Murthy’s remarks. Psaki’s statement has not yet become a focal point of the cycle, 
although right leaning publications are framing her remarks as a sign of censorship collusion between big tech and 
Democrats. Statement, Psaki transcript, and full coverage report included below. We will follow up with this group if 
there are any new developments. 


Many thanks, 


Statement: We've partnered with government experts, health authorities and researchers to take aggressive 
action against misinformation about COVID-19 and vaccines to protect public health. So far we've removed more 
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Exhibit 55 


Internal Facebook email 
correspondence 


523 


Email response back to Surgeon General’s office based on meeting today. Summary of meeting below for 
reference. 


Follow up e-mail to Eric/Kyla KO 


Hi Eric and Kyla, 


Thank you again for reaching out to us and ppOvi ore context to the ongoing discussions 
around the Surgeon General’s recent ann nt. We wanted to follow-up with you on a few 
questions you asked in the meeting focuged rowdTangle, data on the online interventions, 


and Facebook’s borderline -) 
We also want to emphasize the séara ery much interested in having better insight and more 


collaboration to understand th stata bse by your teams to analyze COVID-19 misinformation. 
For instance, we have rear al times that when the White House talks to people who are 
hesitant, they cite Face asdhe number one source for their information about the virus. We 
would like to better nee where this data comes from, so that we can work to understand 
this claim. We thin t Will better inform our collaboration going forward and ensure a shared 
understanding of what content is surfacing online and inform possible additional solutions going 
forward. 


More information on CrowdTangle (CT): 

e Can confirm no plans to wind down or change the ability for people to access 
CrowdTangle. 

e A few months ago we moved management of CrowdTangle from the Partnerships team 
into our Central Integrity team, so that we can develop a more comprehensive strategy 
for how we build on all of the different transparency efforts across the company. 

e This means reconciling differing approaches across other initiatives like our quarterly 
Community Standards Enforcement Report, the Ads Library, the Facebook Open 
Research and Transparency platform and our new Transparency Center. 
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Interventions that we mentioned, some of which specifically create friction in how people 
consume information: 
e Here are some examples of interventions we have put in place during COVID-19: 
o WhatsApp forward limits cut highly forwarded messages by 70% (link) 
WhatsApp Search the Web function within forwarded chats (link) 
Facebook warning labels on fact checked content (link) 
Establishing the Alliance for Advancing Health Online (link) 
Informational labels on posts about COVID-19 vaccines and friction when 
someone goes to share these posts on Facebook and Instagram (link) 
COVID Policies: 
e We remove COVID-19 content that contributes to the risk of imminent physical harm 
including numerous false claims about the COVID-19 vaccine. Full list of claims is in our 


Oo 0 0 90 


Help Center. 

e We permanently ban Pages, Groups, and accounts that repeately bjeak our rules on 
COVID misinformation. 

e We also reduce the reach of Posts, Pages, Groups and acc that share other false 
claims that do not violate our policies but may present misleading or sensationalized 
information about COVID-19 and vaccines. These Oe are public and you can review 
them for yourself on our COVID Help Center u ip ele “Reducing the Distribution 
of Certain Other Vaccine Content and Removin es, Groups, and Instagram 
Accounts that Violate our COVID-19 and ine Policies and are Dedicated to 


Discouraging Vaccination.” Y 


On behalf of the team, SS) 


Summary of meeting for reference 


OR A OK OK eR OK oR OK OK OK OK OK OK OK KOK KK KK 


Good afternoon everyone, 


Following up here quickly after the meeting with staff from the Surgeon General’s office earlier today 
(Friday, July 16th) 


The Health and Executive Branch teams, including KX, met with officials from the Department of Health 
and Human Services (HHS)/Vivek Murphy’s office to discuss the Surgeon General’s advisory on COVID 
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misinformation. The HHS team was represented by Eric Waldo, the Director of Engagement for the US 
Surgeon General, and Kyla Fullenwider, who is assisting with HHS’ efforts to address misinformation. 


Eric Waldo kicked off the meeting saying that the Administration is concerned about misinformation 
generally and also made it clear that the Administration is indeed concerned that misinformation on FB’s 
platforms is jeopardizing proactive COVID vaccination efforts. He noted that some progress by FB on 
curtailing misinformation has been made, but that our work has fallen short and his outreach is to 
encourage us to do more. Kyla said HHS wants to find that middle ground on interventions to address 
COVID misinformation that are both “doable and meaningful.” HHS believes "the speed at which 
misinformation is spreading is unprecedented, and it is quantifiably having impacts on COVID response." 
HHS noted that addressing this is critical in the weeks and months ahead. 


Discussion also focused on four main areas of concern for HHS: (1) enhanced measures to detect 
misinformation, evaluate its impact, and share this information publicly (2) im ed strategy on 
transparency about misinformation, (3) quicker actions on harmful content, and (4)jhigh-quality sources 
and information on COVID. In response to these concerns we said that we generally agree with these 
concerns and are doing our best to address all of them. For example ed that we made 
CrowdTangle available to select staff at the White House and Center forQisease Control to increase 
transparency and expand visibility within our platforms. We 7s Gia He that we have (A) invested 
considerable resources to improve our misinformation policiés dad.enforcement actions, (B) limited the 
number of users a link can be sent to via messenger to stifle the ability to spread misinformation, (C) 
partnered with more than 80, third-party fact checkeys 
apply warning labels to content where warranted stantially demoted borderline COVID 
information, even if it is not false in order to pro e responsible actions to address the threat of COVID, 
(E) created a COVID Information Hub to maké credible COVID information more widely available, and (F) 
partnered with the USG to create profile part of a social norming process to spur people to get 
COVID vaccinations. 


valuate the veracity of information and then 


We had two main goals for this im We asked the officials (1) for their data source or sources that 
lead them to believe that misi orn atfon on our platforms is having a significant impact on their COVID 
response and that we ar © a sufficient job addressing it, and (2) if they were willing to work 
more closely with us, cally through our research team, to identify sources of misinformation, so 
that we can expedit remove such threats. The HHS officials said that they will come back to us with 
“next steps” that may ifelude more coordination between us and HHS on misinformation. 


We left the meeting with the impression that though they want us to do more to combat 
misinformation, they aren’t sure how to encourage us to take down more problematic content. They see 
this as a black and white issue, but want to have more conversations with the White House team and 
other technology companies to inform their next steps. Although they recognize that we are diligently 
working on this issue and have demonstrated a willingness throughout the pandemic to work with them 
to address their concern, Eric Waldo said the White House will likely continue to bring up concerns 
about COVID misinformation on social media platforms. They finished the meeting thanking us for our 
work and said they would like to meet again soon to discuss the matter further. We owe them an update 
on our long-term plan for CrowdTangle use for COVID-19 misinformation, a link to our Community 
Standards explaining borderline COVID content policies, and any stats we can share about the 
effectiveness of our interventions (i.e., interstitials). 
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Recap of Jen Psaki's public request to FB during the press conference for reference: 


1. Measure and publicly share the impact of misinformation on our platform; 
Create a robust enforcement strategy that bridges our properties and provides transparency 
about the rules; 

3. Take faster action against harmful posts; 

4. Promote quality information sources in the feed algorithm 


Ne 


Eric Waldo 
Director of Engagement for US Surgeon General, Dr. <) rthy 
e Executive Director of Michelle Obama’s er initiative for nearly 14 years. He helped 


inspire students in the U.S. to take ae eir future by completing a post-secondary 


Short Bios O 
a 


education, whether at a professi ng program, a community college, or a 2-year or 
4-year college or university. 

e Deputy Chief of Staff at t CJ ent of Education (ED). He helped lead and manage ED 
through President Cc) ric investment of $100B in education funding via the Recovery 
Act 

@ One of the first & hired on the 2007-2008 Obama Campaign, and served Deputy Staff 

g | 


Counsel, pr guidance on a wide array of election protection and operational issues 
for the $750 bama enterprise. 


e J.D. from the University of Chicago Law School, an M.Ed. from Harvard University, and an A.B. 


from Brown University. 
- A Goodby Q&A With Eric Waldo 


Kyla Fullenwider 


Fellow and Research Faculty, Data and Digital, Becker Center for Social Impact and Innovation, 
Georgetown University 


e Inher position at Georgetown University she has been working on two main projects: Public 
Data Integrity and Digital Census Project. 
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e She’s also a Senior Fellow at the National Conference on Citizenship. She leads its Census 
portfolio of work focusing on” what local governments, journalists, leading digital platforms, and 
the public can do to prepare and participate in this crucial function of our democracy.” 

e@ She previously served as the first Chief Innovation Officer of the U.S. Census Bureau, the 
principal agency of the U.S. Statistical System and part of the Department of Commerce. Kyla 
also served as a White House Presidential Innovation Fellow. 

She has a BA from Harvard and MA from the Maryland Institute of College of Art. 
Her full-lenth bio can be found here. 


External Attendees: 
e Eric Waldo 
e kyla » 


Internal Attendees: 
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Exhibit 56 


Internal texts between Mark 
Zuckerberg, Sheryl Sandberg, Nick 
Clegg, and Joel Kaplan 


529 


ubject: JK-NC-SS-MZ 


Participants: Joel Kaplan whatsapp.net, Nick Clegg whatsapp.net, 


whatsapp.net 


Sheryl Sandberg 
Fram: Sheryl Sandberg whatsapp.net; time: 07/16/202 1:58:22; timestamp: 


Ugh en Biden today. Nick I iike your statement. 


From: Nick Clegg whatsapp-.net; time: 0 6/2021 4:02:42% timestamp: 
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fulsome, but weat™rce doing 1 and 2 and Lae™m writing to rageon General now 


highlighting that what theys€ re saying if untrue etc 


re Sheryl Sandberg whatsSapp.net; me: ave &: saoe Stamey 


And scapegoating oft the record as wel-e right? 


n 


om: Sheryl Sandberg whatsapp.net; time: PflO/2021 163 34:ile timestamp: 


I Want to be iS aggress.ve as you can foe with 


rom? Nick Clegg Wwhatsapp.nets time: 07/16/2021 14:33:4D¢ timestamp: QI 


Zuckerberg 
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“an we include that the WH put pressure on us to censor the Lab Leak theox 


From: Nick Cleqq Whatsapp.nets time: i {292 6:56:23; timestamp: [a 


*t think they 


gene ¢ pressure 


Ficasiy ato ns 14€ cab leah 
rent cyc ce among onser atives 
r speech 
From: Sheryl Sandberg whatsepp.nets time: ) 2 $457 mes lam: 


i think they are acapegoating us to cover thelr own missed vaccination rates and a 
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és thatat™s what want re pointing t report iske thas: 
https: WwW. amp/s/www.latimes,.com/california/story/2021-07-15/1l-a- nty- 
@ii.-require-t ors-amid-c id-1 surge = amp=true 
ut yu —} 3 te are pelng t 2 bY st tney e 1g caemanded more act f 
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Mark ¥ . 

rome 7 ‘ J Bethel hse timestamp: 

. * Zuckerberg ’ ” SWES SST Se LVF ane Leprenge 

just want to cho what Shery. is saying that we should I y assertive about 
pusning | here. 
= me Mark 4 ~ /) . - “* > t . 

_— Zuckerberg j ha ; ‘ , ae _— ia 
We have done so much Lo premete authoritative intormation and have been more eftiective 
than other piattorms ombating misintornat n. This S scapegoating at ts Worst. 
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Mark 


Fr 1: Zuckerberg 
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em: Nick Clegg 
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nee anything 


rom: Sheryl Sandberg 


From: Sheryl Sandberg 
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Exhibit 57 


Internal Facebook email 
correspondence 


533 


From: </O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Been SSE SE, Gee ee 


cc: 


Sent: 7/16/2021 12:26:58 PM 
Subject: Re: Push back on CCDH vaccine misinformation report 


Acredfi Planning on having Nick reach out directly to Murthy today on this front. Totally agree that we need 
shared truth on the scope of the problem or at least on the data being used to portray it. Will find time for this 
group to meet to chart how best to make these points directly to the White House and potentially publicly 


Get Outlook for iOS 


From: EE ob .com> 


Sent: Friday, July 16, 2021 3:02 PM 


Subject: Re: Push back on CCDH vaccine misinformation report ‘ 
Hear! Hear! a 


To answer fi question to me—! have not looked at some of this data like theX>CCDH, but we will do so and 


get back to you with a perspective and what more we think we can do in the short and longer term. | am also going 
to discuss with eee set aside other work and focus on this for H2. | will let you know if we move 


forward with that plan after | discuss it with her. 


From: fb.com> 
Date: Friday, July 16, 2021 at 11:58 AM 


ti‘ 
fb.com>, 


Subject: Re: Push back on CCDH vaccine misinformation report 
Thanks all! 
It seems like these data are now being used to guide major governmental policy decisions. 


If they are misleading or incorrect, that can be damaging to (our and their shared) efforts to arrive at 
productive and substantive solutions, so | think critical we establish some shared understanding of 
truth. People also trust the USG to not put out information that is false or misleading and to have 
policy decisions be based on grounded data -- if USG is not doing so, this can result in worse 
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outcomes for the broader ecosystem of efforts here and be counterproductive to our shared goal of 
improving health. 


For example, it seems like the WH thinks that if we just removed these 12 accounts, this would cause 
65 percent of anti-vax misinformation to go away ("there's about 12 people who are producing 65 
percent of anti- vaccine misinformation on social media platforms"). If this were true, | also would want 
us to do this and feel tremendous urgency that we had not -- including exerting policy pressure as 
they are doing -- but it unfortunately isn't that simple. I'm sure we can do better, and would love to 
discuss how, but it's much more nuanced -- and we have executed on many of the obvious things. 
(Understand that some of the accounts are still on our platform, but removing them won't have any 
appreciable impact on anti-vax misinfo, which | think is the actual substantive goal). 


Similarly, Jen P also said that we've "chosen not to" do anything to promote quality information in 
News Feed, which is obviously completely false -- if this were true, | again would feel a lot of urgency, 
but the reality is we've been promoting this at a scale that has not been done before, and we and our 
many partners who have been working on this for the last 1.5 years have data showing it's working. 
I'd love to collaborate more on how to do this even better (as we are doing with Covid Community 
Corps and others), but that's a fundamentally different solution space than how they are framing 
things. 


Is there some way we can make these points directly to WH, with our partners, and potentially more 
publicly? 
Thanks, S 
From: P< 
Sent: Friday, 1 10:58 AM 


fb.com>; BS < ccobb @fb.com> 


@fb.com> 


Subject: Re: Push back on CCDH vaccine misinformation report 


Adding in (a cre as well — we have a meeting in 3 mins on covid reputation work that we'll 
repurpose to talk about this too 


From: Eo f.com> 
Date: Friday, July 16, 2021 at 1:34 PM 
_ See: 
SEE O{b.com>! 

Cc: {> .com>. 


Subject: Re: Push back on CCDH vaccine misinformation report 


From: i fb .com> 
Date: Friday, July 16, 2021 at 10:21 AM 
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Subject: Push back on CCDH vaccine misinformation report 
Hi 


| lead our Misinfo Policy team and wanted to reach out to ask for your support, per a conversation between me, 
and a couple of others this morning to prep for a meeting we have with the US Surgeon 
General's office this afternoon. 


We're continuing to hear people who allege FB is contributing significantly to vaccine hesitancy cite Center for 
Countering Digital Hate (CCDH) reports, which have found 65% of anti-vaccine content on social media comes 
from 12 individuals. Comms has previously complied some clear pushback here, and just this week our Misinfo 
Policy team combed the CCDH reports again and identified a couple of additional areas we believe represent 
flawed reasoning and methodology. 


We'd love to be able to push back more publicly on the report but before doing so were wondering if 1) you've also 
reviewed the reports and agree with our analysis below, and 2) there is other research/data you believe we should 


be sharing as part of our push back. 

Please let me know if it would help to get on a call together, and thanks so much fo NS evectv you can 
provide. We don't need input by any particular deadline but would ideally be ab his together in the next 
week or two to inform our ongoing conversations with the US administration. 


Misinfo Policy looked at the reports here and here and concluded: 


(1) CCDH says there were 29 million "potential impressions" on misinfo content, based on 105 pieces of content 
they said violate our policies and multiplied by the number of followers those accounts have. This methodology 
disregards demotions we place on content (through predicted misinfo, actor penalties), the fact that if violating 
many of these posts were likely deleted, assumes everyone following these Pages or Groups saw every one of 
these pieces of content, which we know is unlikely, and that many of these posts may have had informative labels 
to educate the user. 

(2) They say the Disinfo Dozen accounts for 73% of Facebook's anti-vax content. This is based, in part, on 
looking at links people shared on Facebook and Instagram to Disinfo Dozen owned webpages (not hosted on 
FB). They then want us to de-platform the Dozen based on this content (of course, we don't deplatform uses 
based on content they post off-platform). Moreover, even if we banned all FB/IG presences associated with the 
disinfo dozen, people would still be able to share these links to our platforms, as we don't believe it's appropriate 
(or feasible) for us to police content hosted off platform. 
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Exhibit 58 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy 


537 


From: Nick Clegg </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=NCLEGGE6E> 


To: Murthy, Vivek (HHS/OASH) 

Cc: Beckman, Adam (HHS/OASH); Waldo, Eric (HHS/OASH); 
Sent: 7/19/2021 10:34:04 AM 

Subject: Re: Message from Nick Clegg 

Hi Vivek 


Thanks so much for getting back to me — really appreciate that. 


Adding {J anc fi here to liaise with your office to find a time asap which is convenient for you — I’m in 
Spain right now but hopefully time differences can be navigated so that we speak soon enough. 


All best 


Nick 


From: "Murthy, Vivek (HHS/OASH)" {BO hhs. go> 
Date: Monday, July 19, 2021 at 3:29 PM 


To: Nick Clegg <{J @fb.com> 
Ce: @fb.com>, "Beckman, Adam (HHS/OASH)" <i @hhs. gov>, 


"Waldo, Eric (HHS/OASH)" <i @hhs.gov> 
Subject: Re: Message from Nick Clegg 


Hi Nick, 


Thanks for reaching out and for sharing your concerns. | know the last few days have been challenging. I'd be 
happy to speak directly about how we move forward. Let me know the best way to schedule some time later this 
week and we'll make it happen. 


Best wishes and will talk soon, 
Vivek 


Vivek Murthy 
U.S. Surgeon General 
Vice Admiral, U.S. Public Health Service 


The information inthis e-mail and its attachments are confidential, pre-decisional and deliberative. Contents may include sensitive information and are for 
Official use only. If youare not the original intended recipient, please delete the content and notify the sender. 


From: Nick Clegg <{ij@fb.com> 
Sent: Friday, July 16, 2021 5:43 PM 


To: Murthy, Vivek (HHS/OASH) <3 @hhs. gov> 


Cc: EE BO 1 com> 
Subject: Message from Nick Clegg 


Dear Vivek. 
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Reaching out after what has transpired over the past few days following the publication of the misinformation advisory, and 
culminating today in the President’s remarks about us. I know our teams met today to better understand the scope of what the White 
House expects from us on misinformation going forward. 


In our previous conversations [ve appreciated the way you and your team have approached our engagement, and we have worked 
hard to meet the moment — we've dedicated enormous time and resources to fighting this pandemic and consider ourselves to be 
partners in fighting the same battle. Certainly we understand (and have understood for some time) that there is disagreement on 
some of the policies governing our approach and how they are being enforced — even as your team has acknowledged the 
unprecedented scale of our efforts to provide authoritative information to millions of Americans and to help them get vaccinated. 
But I thought the way we were singled out over the past few days has been both surprising and misleading, and I believe 
unproductive to our joint efforts too. 


I would appreciate the opportunity to speak directly to discuss a path forward with you and how we can continue to work toward 
what I sincerely believe are shared goals. 


Yours 


Nick 
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Exhibit 59 


Internal Facebook email 
correspondence 


540 


From: 


/O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=8E98834A8DAB4AA28B1 A5COB98E6C555> 


To: 

cc: 

BCC: 

Sent: 7/19/2021 6:56:27 AM 

Subject: Re: Capturing the delta on covid misinformation 


(moving filo bcc) 


The source is here: https://fwiwnewsletter. substack.com/p/facebook-has-a-vaccine-misinfo-problem. Given it 


doesn't specify individual posts, it may be harder to do a full analysis with policy assessments and counter stats 
but let’s see what we can try and pull. 


I’ve started a table with what | think would be helpful if we can get it in this doc: https://docs.qgoogle.com/document 
/d/13ytU3wT 2rMJnU97OGP yDS6ChGFxznXbweimBk_M5o0BA/edit 


do you think your team could do a first pass at what we can find and then we can try and 
track down the Top N/VPV numbers if we have individual posts? 


From: fb.com> 
Date: Monday, July 19, 2021 at 9:34 AM 


fb.com>, 


Subject: Re: Capturing the delta on covid rere, 


BB ertioned press on Friday that reported o. info like this—would be helpful if we can track down the 
source so that we can have the context. Adding Brandi f00 in case she has awareness. 


From: SO" com> 
Date: Monday, July 19, 2021 at 9:20 AM 


Subject: Re: Capturing the delta on covid misinformation 


I’m not sure whether anyone else has flagged the table. | can’t speak to its veracity, but it's a good place to begin 
a query. Can you grant access to the google doc linked to below? 


Date: Monday, July 19, 2021 at 9:19 AM 
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@fb.com>, iii 


@fb.com>, 


Subject: Re: Capturing the delta on covid misinformation 


= can have my misinfo team look at these pages if that would help. Let me know. | would note, 
though, that this chart has "ABC World News Tonight" as posting vaccine negative information... 


From: {Ef com> 
Sent: Monday, July 19, 2021 8:48 AM 
@fb.com>: 


Subject: Re: Capturing the delta on covid misinformation 


We should also pull the data for where (or if) they appeared in the top N as well - we should be able to do this from 
the WH reports. 


Is the table above in a doc somewhere so we can start populating it? 


Get Outlook for iOS 


From: Eo f1.com> 
Sent: Monday, July 19, 2021 8:05:31 AM 


Subject: Re: Capturing the delta on covid misinformation 


Got it. Thanks. This is the type of thing we're fig ve we (or can we) look at each of the negative posts to 
see if they either violate, or would be caught in the delta that we are working on identifying for what the WH would 
want removed (vs what we do remove)? 


Get Outlook for iOS 


From: SO t,.com> 
Sent: Monday, July 19, 2021 7:45:09 AM 


Subject: Re: Capturing the delta on covid misinformation 


| should clarify that this is circulating ON FB not internally. | came across the list this weekend on a friend's post, 
but I'm not sure where it originated. 


Get Outlook for iOS 
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Sent: Monday, July 19.2021 7:36:28 AM 


Subject: = aes = = on covid misinformation 


Thanks fj-do we know who is circulating this? Vas it provided by an external source or did we generate it? 
Sounds like it's known about outside of the company. 


Get Outlook for iOS 


From: EE fb com> 


19, 2021 6:53:53 AM 


Subject: Re: Capturing the delta on covid misinformation 


There's a purported CT list floating around FB that fits the description (see below). | haven't seen the actual Crowd 
Tangle list. 


Q 
© 
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Get Outlook for iOS 


From: RS tb.com> 
Sent: Monday, July 19, 2021 6:24:13 AM 


: @fb.com>; fb com> fb.com>: J 
———— @fb.com>: . ; 


i@fb.com>; 


@fb.com>; 
Ce: @fb.com> 
Subject: Re: Capturing the delta on covid misinformation 


From an exchange yesterday—Nick is hoping we can chase down a top ten list where 7 out of top ten most 
popular posts were anti-vax, and the top was a Candace Owens post about how the Govt is hiding data about 


vaccine deaths. Seems like this could have come from CT? Could we check into whether this matches what's 
being described? 


Get Outlook for iOS 


From: I tb,com> 
Sent: Saturday, July 17, 2021 2:32:14 PM 
: Dfb.com>; 


Subject: Re: Capturing the delta on covid misinformation 


The thread split so am coping esponse below, but we've pulled this into a doc here: https://docs.google.com 
/document/d/13ytU3wT 2rM JnU97OGPyDS6ChGFxznXbwejmBk_M5o0BA/edit 


I’ve not actually heard specific criticisms on your #2 below fi tact checked content) so I’ve lumped them into two 
buckets: 1) content on the platform in general (B2V and fact checked); 2) the disinfo dozen 


| think we pulled some examples for Nick’s podcast with Andy S that we could maybe add in here to demonstrate 
Nell’s point as well about content we won't be comfortable removing — we could add that in to this doc here. 


ae -: us know what other details we should pull for you. I’ve captured the DS and research work that is 
underway as well 


ma epy. 


| think better understanding the deltas would be great! Have they (Rob or otherwise) explicitly told us what they 
think we should take down or downrank more and are not? 


That would be a helpful starting place and | think if they haven't been specific here a good place to push them to 
get clearer understanding vs. grandstanding. 


The public quotes I've seen are: 


1) Removing the 12 accounts or other head contributors to problematic VPVs (but based on being 
misinformed about what impact that would have, | believe -- per Peter there is no way it's 65 pct of 
problematic VPVs). 


2) Potentially blocking head domains of problematic VPVs (they haven't explicitly said this but could 
be an extension of (1)). 

3) Making sure that top B2V content spreads slower / gets less distribution in general (and maybe 
gets removed?) perhaps via the top engaged vaccine post list in Crowdtangle or the top reached 
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posts we have been sharing with them for months. 


We were going to quantify pct VPV impact of (1) and (2) as part of an Integrity DS exercise early next 
week, would be good to include the full list of things to evaluate including Nick's question here and 
also to your point have specific examples we can discuss at a policy level in addition to the VPV 
impact analysis. 


| would also recommend expediting publicly sharing the top N reach data that we have already shared with WH 
since it's something they asked us to do as part of the advisory, and | think we all agree it better contextualizes the 
overall info ecosystem, e.g. top reach vax is majority credible and authoritative. Is this something we are 
considering doing? 


fb.com> 


Subject: Re: Capturing the delta on covid misinformation 


Adding a few others. There are probably a couple of ways to define what they want removed that maybe we can 
detect (although the folks who have been talking to them should definitely better educated views): (1) all b2v 
content; (2) any fact-checked covid content (although there’s a year of pre-vaccine content there that might be 
crazy but wouldn't directly relate to vaccine hesitancy); (3) any content containing a link associated with the off 
platform sites run by anti vaxx groups/people. 


The Surgeon General's report defines covid misinformation to include people posting truthfully about experiencing 
rare side effects, which we obviously strongly disagree with. | don’t know if we'd have any ability to detect that 
content, but it’s an important thing for us to be aware of. 


From: RE 2 t0.com> 
Sent: Saturday, July 17, 2021 7:57 AM 


Subject: Capturing the delta on covid misinformation 


Nick asked this morning if we could run an exercise to determine the content that the White House would want us to 
remove vs what we are currently removing, so that we can demonstrate that we are in fact removing a sizable 
proportion of content and that the remaining delta is not content that the general public would be comfortable with 
us removing. 


First thought is to capture the content that’s being posted by the disinfo dozen (since that’s a specific point of 
contention that’s been raised) and then also to look at crowdtangle for the content that’s highest performing. Is this 
the right group to kick off this exercise? And there may be a better way of looking at what the delta actually 
is...welcome thoughts on that front. 


Get Outlook for iOS 
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From: Nick Clegg </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=NCLEGGE6E> 


To: 
Sent: 7/19/2021 4:20:07 AM 
Subject: Re: Capturing the delta on covid misinformation 


Is this a list we have drawn from CT, or we have provided to WH? Or publicly available? 
We seem to be stuck - again - on the engagement vs views issue... 


N 


Get Outlook for 10S 


From: I fo com> 
Sent: Monday, July 19, 2021 12:15:14 PM 
To: fb.com>; 
Subject: Fwd: Capturing the delta on covid misinformation 


@tb.com> 


Nick—see below from I'm supposed to be talking to Rob today but wanted to see if we could identify this 
without asking first 


Get Outlook for iOS 


From: © fb.com> 
Sent: Monday, July 19, 2021 6:53:53 AM 


Ce: @fb.com> 
Subject: Re: Capturing the delta on covid misinformation 


There’s a purported CT list floating around FB that fits the description (see below). | haven't seen the actual 
Crowd Tangle list. 
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Get Outlook for iOS 


From: HS t.com> 


Sent: Monday, July 19, 2021 6:24:13 AM 


Subject: Re: Capturing the delta on covid misinformation 


From an exchange yesterday—Nick is hoping we can chase down a top ten list where 7 out of top ten most 
popular posts were anti-vax, and the top was a Candace Owens post about how the Govt is hiding data about 
vaccine deaths. Seems like this could have come from CT? Could we check into whether this matches what's 
being described? 


Get Outlook for 10S 


From: SII t,.com> 
Sent: Saturday, July 17, 2021 2:32:14 PM 


Subject: Re: Capturing the delta on covid misinformation 


The thread split so am coping {J response below, but we've pulled this into a doc here: https://docs.qgoogle.com 
/document/d/13ytU3wT 2rMJnUS7OGPyDS6ChGFExznxXbw6jmBk_M5o0BA/edit 


I've not actually heard specific criticisms on your #2 below Nell (fact checked content) so I’ve lumped them into two 
buckets: 1) content on the platform in general (B2V and fact checked); 2) the disinfo dozen 


| think we pulled some examples for Nick’s podcast with Andy S that we could maybe add in here to demonstrate 
Nell's point as well about content we won't be comfortable removing — we could add that in to this doc here. 


ras let us know what other details we should pull for you. I've captured the DS and research work that is 
underway as well 


my 
Adding Integrity PM a: SS ws 


| think better understanding the deltas would be great! Have they (Rob or otherwise) explicitly told us what they 
think we should take down or downrank more and are not? 


That would be a helpful starting place and | think if they haven't been specific here a good place to push them to 
get clearer understanding vs. grandstanding. 


The public quotes I've seen are: 

1) Removing the 12 accounts or other head contributors to problematic VPVs (but based on being 
misinformed about what impact that would have, | believe -- per Peter there is no way it's 65 pct of 
problematic VPVs). 

2) Potentially blocking head domains of problematic VPVs (they haven't explicitly said this but could 
be an extension of (1)). 

3) Making sure that top B2V content spreads slower / gets less distribution in general (and maybe 
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gets removed?) perhaps via the top engaged vaccine post list in Crowdtangle or the top reached 
posts we have been sharing with them for months. 


We were going to quantify pct VPV impact of (1) and (2) as part of an Integrity DS exercise early next 
week, would be good to include the full list of things to evaluate including Nick's question here and 
also to your point have specific examples we can discuss at a policy level in addition to the VPV 
impact analysis. 


| would also recommend expediting publicly sharing the top N reach data that we have already shared with WH 
since it's something they asked us to do as part of the advisory, and | think we all agree it better contextualizes the 
overall info ecosystem, e.g. top reach vax is majority credible and authoritative. Is this something we are 
considering doing? 


From: "2 com> 
Date: Saturday, July 17, 2021 at 11:08 AM 


Subject: Re: Capturing the delta on covid misinformation 


Adding a few others. There are probably a couple of ways to define what they want removed that maybe we can 
detect (although the folks who have been talking to them should definitely better educated views): (1) all b2v 
content; (2) any fact-checked covid content (although there’s a year of pre-vaccine content there that might be 
crazy but wouldn't directly relate to vaccine hesitancy); (3) any content containing a link associated with the off 
platform sites run by anti vaxx groups/people. 


The Surgeon General's report defines covid misinformation to include people posting truthfully about experiencing 
rare side effects, which we obviously strongly disagree with. | don’t know if we’d have any ability to detect that 
content, but it’s an important thing for us to be aware of. 


From: IS com> 
Sent: Saturday, July 17, 2021 7:57 AM 


Ce: 
Subject: Capturing the delta on covid misinformation 


Nick asked this morning if we could run an exercise to determine the content that the White House would want us to 
remove vs what we are currently removing, so that we can demonstrate that we are in fact removing a sizable 
proportion of content and that the remaining delta is not content that the general public would be comfortable with 
us removing. 


First thought is to capture the content that’s being posted by the disinfo dozen (since that’s a specific point of 
contention that’s been raised) and then also to look at crowdtangle for the content that’s highest performing. Is this 
the right group to kick off this exercise? And there may be a better way of looking at what the delta actually 

is... welcome thoughts on that front. 


Get Outlook for iOS 
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Exhibit 60 


Email correspondence between 
Facebook and the White House 


/O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 


From 
OBB487E8111461E3692A624> 
To: Flaherty, Rob R. EOP/WHO; Dunn, Anita B. EOP/VWHO 
Sent: 7/17/2021 3:23:47 PM 
Subject: Re: hoping to connect 


Thanks J Hi Anita and Rob — definitely agree and look forward to connecting. 
Sending a post that went live this afternoon with information that I know we've discussed in the past. We had a 
conversation with the Surgeon General's office yesterday to discuss the advisory In more detail and hope to 


continue to work to address concerns. 


Along with | = am really hoping to close the gap in terms of what's playing out publicly end what we might 
be able to accomplish working together. 


Rob—I'm around anytime for a conversation. 


https “about. fb.comy news’ 202 1 07/support-for-covid-19-vaccines-is-high-on-facebook-and-growing: 


Get Outlook for 10S 


From: ST © f.com> 

Sent: Saturday, July 17, 2021 6:14 PM 

To: Flaherty, Rob R. EOP/WHO; Dunn, Anita B. EOP/WHO: aaa 
Subject: RE: hoping to connect 


Thanks Anita, and thanks Rob. | appreciate the willingness to discuss. We'd love to find a way to get things back 
to a productive conversation. Adding in JNMRo help us here — obviously Rob and ave a tight working 
relationship already. 


From: Flaherty, Rob R. EOP/WHO <I own0.cop.gov> 


Sent: Saturday, July 17, 2021 3:06 PM 


To: Dunn, Anita B. EOP/WHO <{@who.eop.gov> 
Ce: @fb.com> 


Subject: Re: hoping to connect 


Hi MJ Happy to connect. 


Sent from my iPhone 


On Jul 17, 2021, at 5:56 PM. Dunn, Anita B. EOP/WHO RB 0 w10.200.00> wrote: 


Hi, and thanks for reaching out. I'm adding Rob Flaherty, our Office of Digital Services Director, to this 
chain as well because he has been following your platform {and others) closely when it comes to flow of 
information and misinformation. 
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Perhaps it makes sense to schedule a conversation? 
Anita 


From: i of com> 
Sent: Saturday, July 17, 2021 5:52 PM 
To: Dunn, Anita B. EOPAWHO < w0.cop cov> 
Subject: [EXTERNAL] hoping to connect 


Hi Anita - hope you are well, 


Would love to connect with you on the President's comments on Covid minsinfo and our work there. Really could 
use your advice and counsel on how we get beck to a good place here. 


While there’s always been a disagreement on where the lines should be on minsinfo generally, we have genuinely 
tried to work with the administration in good faith to address the gaps and solve the problems. As | hope you 
anow, we've been doing a significant amount of work to both fight the misinfo and fight the pandemic through 
authoritative information. Obviously, yesterday things were pretty heated, and I'd love to find a way to get back to 
oushing together on this - we are 100% on the same team here in fighting this and | could really use your advice. 


Thanks, 
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Exhibit 61 


Internal Facebook text thread 


554 


Short Message Report 


Conversations: 1 Participants: 3 
Total Messages: 36 Date Range: 7/19/2021 


Outline of Conversations 


[) —_NODISPLAY « 36 messages on 7/19/2021 - A <I Gs wh atsapp.net> + Nick Clegg 
< GR ©) ss eisapp.net> 
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Messages in chronological order (times are shown in GMT +00:00) 


C) NODISPLAY 


# Bae EES 


7419/2024 


éVd 


11:15 AM 


yeah one point in this that | hope lands for you is this: ' Facebook's PR strategy, arguing that historically, Facebook will trot 
out statistics and “emphasize the denominator to obscure the numerator, and vice versa when it’s more advantageous.’ 


# 2 eee 


| haven't got through to the team well enough 


# za, eee 


if we just focus on bottom of the funnet here | think we'll do better 


Vaccine hesitancy rate in this case 


+ 


7/19/2021 


7/19/2021 


| feel the team pushes us to release numbers they think sound good but then get directly undermined and we're 


scrambling 


7/19/2021 


| think this article makes that point well (i.e. the thing about the denominator not mattering as we think it does) 


Nick Clegg 


7/19/2021 


11:15 AM 


11:16 AM 


11:16AM 


11:18 AM 


11:45 AM 


Yea fair point - and then of course we're v stuck on the engagement vs views issue (the WH advisor I've been dealing with 


is totally focused on top 10 Crowdtangle Covid posts) 


# EES eee 


That's not the issue there 


The issue there is above all 


- SSS pees 


Page posts are a tiny sub set of all posts 


Page link posts are a tiny subset of page posts 


# aa cre 


It's a gerrymandered list even within Crowdtangle 


Nick Clegg <I s- 


7/19/2021 


7/19/2021 


7/19/2021 


2:11 PM 


1, 2:11 PM 


1, 2:12 PM 


2:12 PM 


2:12 PM 


Sure - but no one/no one understands that outside MPK, most especially the political WH staff. And all they can go on is 
the way it is presented to them by Crowdtangie - we can hardly blame non experts from reacting to data which is 


presented to them in a partial manner. 


Nick Ceo 


7/19/2021 


3:38 PM 


The Surgeon General has just sent me a conciliatory reply - | will be meeting him later this week - so I'll work with you to 


ensure the data context/exptianation is provided to him in the clearest terms possible 


a ee 


it actually isn't how it's presented in crowdtangle. Selecting to just links is subselecting 


I == eee 


| agree with the rest of your point on the just pages bit 
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cool thank you please do | can help 


Nick Clegg < 7/19/2021. 4:30 PN 
| am about to leave for you ok if | ask the team hit to pick your brains on best way to explain this 


in language Surgeon General will understand? Or who on the data team is as good as you in being able to join the dots? 


BE eee 7/19/2021, 4:30 PM 


yes for sure 


30 PM 


as 


and I'll help with Mor small group safe flight 


Nick Clegg < 7/19/2024, 4:31 PM 
| have another hour - never seer so quiet. 


i EE oe, 7/19/2021, 4:31 PM 

# ae eee 7/19/2021, 4:31 PM 
my dad said that he thinks everyone just died of covid and we weren't told because everywhere is so empty 

RR 7119/2021, 4:31 PM 
| think everyone went to the coast 
Nick Clegg Ea 7/19/2021, 4:37 PM 
Nick Clegg —_e 7/19/2021, 4:58 PM 


The Biden walkback of his earlier comments is significant - and v deliberate - | think the way he hit back this weekend had 
a real effect 


Ss eee 7/19/2021, 5:02 PM 


| will raise a glass of champagne in toast when my day finishes tonight 


# SS eee TiNDAO2 


I'm really having fun working with you and the team on this stuff. It matters and is interesting 


PM 
likewise! Have been pinging with Hy Willie the significance of the VVH olive branch - it's not every day that a politician 


Nick Clegg 7/19/2021, 5:16 


backs off from colourful rhetoric! 


f 3 __—__- —_____ _—___ 


Nick C< 9 7/19/2021, 6:03 PM 
# SS Ea 7/19/2021, 6:04 PM 


no stress ok cool then you don't 


21, 6:04 PM 


Y ES «eee 7 


safe flight 
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# =a aes 7119/2021, 6:17 PM 


round praise of the strategy, the tone and the push back 


ie 7119/2021, 6:17 PM 


was the content 


# —P2RE — EEE 7/19/2021, 6:17 PN 
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Exhibit 62 


Internal Facebook text thread 


559 


Short Message Report 


Conversations: 1 Participants: 22 
Total Messages: 11 Date Range: 7/19/2021 


Outline of Conversations 


C3 Team Clegg « 11 messages on 7/19/2021 
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Messages in chronological order (times are shown in GMT +00:00) 


C3 Team Clegg 


# Nick Cleo <r 7/19/2021, 5:42 PM 
team - apols, we haven't had the chance to speak but as I'm sure you've guessed I've spent the last several days pretty 
well non stop on this Covid/Biden furore, including tel calls with Andy Slavitt et al till 3 am on several occasions. As you'll 
have seen - and after many calls with MZ/SS - we took a pretty aggressive stance in response to what the WH/Biden said 
about our covid misinfo efforts. Today both Biden and the Surgeon General have issued much more emollient statements - 
the latter also reaching out to me to meet asap - and I've asked fg Oe te See propose some next 
steps to help reset the working relationship with teh WH. It's tricky as they want us to take down content which is by most 
measures annoying/alarming but not necessarily harm inducing misinfo, but we'll see. 


ER es 7/19/2021, 5:51 PM 


Thanks for the update. We are starting to work on your brief for your meeting with SG Vivek Murthy and will make sure 
that aligns with the strategy Kevin, Brian and team are proposing. 


# Nick Clegg <I s - 7/19/2021, 5:52 PM 


thx - the key thing there will be to ensure that | OR al work with mm. disentangle the numerous crossed 
wires re what our data does/does not mean which has been the source of an immense amount of the trouble 


# SSS eee 7/19/2021, 5:53 PM 
Noted - will talk to them and work on that 
ft ae 7/19/2021, 9:47 PM 
An additional thing we could do to repair the relationship with the WH would be to share covid-related misinformation data 
with a trusted third party — e.g.: with Pew Research — and ask Pew to deliver the analysis to us and to the WH. 
ee 7119/2021, 9:50 PM 
It seems that much of the issue with the WH is around trusting our own analyses — but if we could share relevant data 
with a trusted third party we could alleviate some of those concerns. 
There are of course some risks involved — but I think this is a way to improve on our credibility and repair the relationship. 
(This is SJ by the way!) 
ae 7/19/2021, 9:50 PM 
We could do this with Pew — and have concrete results — within a month 
Saas see 7119/2021, 9:51 PM 
if we started now 
z Nick Clegg <I ms 7/19/2021, 9:59 PM 
yea | 
2 Nick Clegg <r 7/19/2021, 10:01 PM 
i've been digging into this with the data team all weekend - it's a bit harder than that becuase there simply isn't consensus 
on what misinfo is, so I've asked the team to do an initial piece of work scoping out what our coverage of misinfo is vs 
what we “think* the WH would like to see. Without an agreed definition, we can't identify the data... 
Eee eee 7/19/2021, 10:24 PM 
Agree, that’s indeed the crux of the problem. And this sounds like the right approach — getting clarity first on the scope of 
what is, and what should be, considered misinfo in this case. 
Do let me know if | can help in any way down the line. This is such a complicated and important topic. 
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Exhibit 63 


Internal Facebook email 
correspondence 


562 


From: /O=THEFACEBOOK/OU=EXTERNAL 
DLT)}/CN=RECIPIENTS/CN=6041D16D677D4937A6D5285C3C068563> 


To: Nick Clegg 
Sent: 7/21/2021 4:49:24 PM 
Subject: Re: Covid misinfo: Delta assessment + Mitigations 


Sounds good 


From: Nick Clegg SR > com> 

Sent: Wednesday, July 21, 2021 2:13:45 PM 

To: Sheryl Sandberg {pfb.com> 

Subject: Re: Covid misinfo: Delta assessment + Mitigations 


Well, I'm pushing r | et al to see wnat more data we can snare with them whichis a big ask from the WH — 
the problem is they disregard the “reach” data ivs engagement} that we already share with them, and they don’t ask 
the same of other cos {YT et al} so I’m going to propose to Surgeon Gen on Fri that he asks for comparative data 
from all the cos not just us which should move things along on that front. 


Re misinfo itself it's worth reading the email from in detail — what the WH appears to want us to remove 
ranges from humor to totally non violating chatter about vaccines. | can’t see Mark in a million years being 
comfortable with removing that — and | wouldn't recommend it. 


We don't need to decide everything at once — we should wait to see what Surgeon Gen tells me on Fri before 
deciding how/wnether we need to make any bigger moves. 


ow tells me that she’s sceptical that the “blackholing” of links actually works in practice — frustrating — so if 
you answer to the wider thread be aware that it’s not yet clear whether it’s workable. 


N 


From: Sheryl Sandberg <J@fb.com> 
Date: Wednesday, July 21, 2021 at 11:01 PM 


To: Nick Clegg on 
Subject: RE: Covid misinfo: Delta assessment + Mitigations 
| am for this — should | reply to the broader thread? 


And you sure we should not do more? 


From: Nick Clegg Bob com> 
Sent: Wednesday, July 21, 2021 1:58 PM 


To: Sheryl Sandberg fb.com> 
Subject: Re: Covid misinfo: Delta assessment + Mitigations 


Possibly the highlighted bit — the team still needs to bottom out details — keen to know whether you and Mark would 
be supportive. N 


From: Sheryl Sandberg fb.com-> 

Date: Wednesday, July 21, 2021 at 10:47 PM 

To: Nick Clegg fb. com> 

Subject: RE: Covid misinfo: Delta assessment + Mitigations 
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Is there anything here we recommend changing? 


From: Nick «Clegg EE fb. com> 


1, 2021 12: Of PM 


fb.com>; 
fb.com>; 


>; fb com>: Joel Kaplan 
fb.com>; @fb.com>: 


~ 


> 


fo.com> 
Subject: Re: Covid misinfo: Delta assessment + Mitigations 


Now with highlighted bit — last ping! N 


From: Nick Clegg IEEE @fb. com> 


Date: Wednesday, July 21, 2021 at 8:54 PM 


Kofb.com> 


om @fb.com> 
mtb.com>, OID.cOmMm->, 


= —— 
com>, (Qfb.com>, fb. com>, iy 
@fb.com>, Mark Zuckerberg l@fb.com>, Sheryl Sandberg [afb. com> 


@fb.com>, Joel Kaplan @fb.com>, 
Ytb.com>, @fb.com>, 


coTD. com>, 
Subject: Re: Covid mi isinfo: Delta assessment + Mitigations 


From: Nick Clegg [EEE fb. com> 


Date: Wednesday, July 21, 2021 at 8:54 PM 
Pofb.com>, 


fb.com>, 


| 


(Oib.com>, 


@fb.com>, 


afo.com>, fo.com> 
Ofb.com>, Sheryl Sandber 
Ofb.com>, 


afb.com> 


D.cOom>, 
Yfb.com>, Mark Zuckerberg 
efb.com>, Joel Kaplan 
fb.com>, 
Ce: tb.com> 
Subject: Re: Covid misinfo: Delta assessment + Mitigations 


Thx | i hugely helpful, am grateful for the rapid work by the team on this. 


Adding Mark and Sheryl (and others for info): ana | are meeting the US Surgeon General on Friday for an 
initial “reset” conversation. | doubt we'll get into many of these specifics — that will likely follow — but having 
discussed with and | think we should let the team complete the policy work on the highlighted option 
pelow before we decide whether to pursue, but not reopen the other avenues (as per the team’s recommendation). 
Do shout if you disagree. 
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There is separate, ongoing work on publishing wider transparency reports incorporating the “top 100 posts” reports 
which we have provided in recent weeks to the WH. 


N 


From: iE 96. com> 


Date: Wednesday, July 21, 2021 at 8:35 PM 


To: Nick Clegg (@ib. com>, 


Subject: Covid misinfo: Delta assessment + Mitigations 


Nick, 


TLDR: There is likely a significant gap between what the WH would like us to remove and what we are 
comfortable removing. There are some policy mitigations that could zet the two parties closer, but Content 
Policy does not recommend pursuing them. 


You asked for information about the delta between content that Facebook is removing and the White House 
wants us fo remove and mitigation options. The White House rarely provides any specificity about what it wants 
removed, but it routinely complains to us about content identified in critical media reports. We've compiled 
specific criticisms and extrapolated from more general complaints below: 


1. Cross-platform disables: 

a. Delta: The WH wants cross-platform disables. We only do cross-platform disables for child 
safety and dangerous organization violations. 

b. Mitigation (not recommended): We could remove all of a person's groups/pages/accounts once 
they have had a single group/page/account removed for covid misinfo violations. This would 
remove approximately 50 non-violating entities associated with the Disinfo Dozen, including many 
entities that have nothing to do with COVID or vaccines. We are continuing to research what other 
entities might be affected. 

c. Background: 

i. Jen Psaki said that if you're banned on one platform, you should be banned on all 
platforms. We do not and should not ban users from FB or IG because they've been 
banned by competitors. We assess FB pages ard profiles and IG accounts based on the 
content they post and do not typically enforce against a nor-violating page/profile/account if 
a connected entity is removed (we only erforce cross-platform on DO! and Child Safety 
violations). This practice has been a point of contention around the “Disinfo Dozen’ 
because we have removed their violating entities (23 entities from 11 of the 12 people) but 
continued to allow their non-viclating entities (53 entities - this set is under constant review 
and number changes often). 

2. Off-Platform Links: 

a. Delta: The WH wants all links to the Disinfo Dozen’s off-platform domains removed. We only remove 
links to off-platform content if the content viclates child safety or dangerous organizations violations. 

b. Mitigation {not recommended): We could remove all posts from FB/IG if the posts contain a link to 
domains associated with covid misinfo violators, but it would likely remove significant amounts of benign 
content posted by regular users, such as their posts about person experiences or government criticism 
that also include a link to a website. Some of the off-FB/IG websites also have nor-covid-related 
content, so we could be removing posts that are not about COVID and link to the websites for 
norn-COVID reasons. Itis unlikely that we have capacity fo review individual off-platform links, so we 
would likely have to execute at a domain level. 

c. Background: 

i. To get to the claim that 65% of covid misinfo comes from the Disinfo Dozen, we assume the WH 
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is complaining about nor-violating content on FB that includes links to content off FB that would 
violate if posted on FB. 

ij. We could blackhole links to any domain or sub-domain associated with pages, groups, or 

accounts removed for violating our covid misinfo policies. We are currently investigating the 

impact that this change would have, including both scope of removals and how much of the 
content would be benign. Given resource constraints, we do not think it Is feasible to review all 
pages before removal. 

We are still collecting information on how much content this would remove and a rough estimate of 

what percentage of that content links to benign versus violating content. 

1. True information: 

a. Delta: The Surgeon General wants us to remove true information about side effects if the user does not 
provide complete information about whether the side effect is rare and treatable. We do not recommend 
pursuing this practice. 

b. Mitigation (not recommended): We currently label all of this content and demote some of it. We could 
remove the content or increase the demotion strength. 

c. Background: 

i. The Surgeon General's report on misinformation defines misinformation as including: “An 
anecdote about someone experiencing a rare side effect after a routine surgery. The specific 
anecdote may be true but hide the fact that the side effect is very rare and treatable. By 
misinforming people about the benefits and risks of the surgery, the anecdote can be highly 
misleading and harmful to public health.” 

ii. Experts have advised us that it’s important to allow people to ask questions and allow open 
discussion of vaccine safety and efficacy to overcome vaccine hesitancy. For content that is 
presented in a sensational or shocking way or promotes vaccine refusal, we demote the content 
and apply a label with a link to accurate, authoritative information. We believe the information 
push partially combats the incomplete information while giving users space to express their views 
and share their personal experiences. 

{. Other Vaccine Hesitant Content: 

a. Delta: The WH generally objects to content that appears in media criticism of our covid misinfo efforts. 
While we don't have specifics, we can extrapolate that they would like us to remove content that provides 
any negative information on or opinions about the vaccine without concluding that the benefits of the 
vaccine outweigh that information or opinion; humorous or satirical content that suggests the vaccine 
isn't safe 

b. Mitigation: Similar to true information, we recommend adhering to expert advice that we allow open 
discussion of vaccine safety and efficacy and do not recommend removing this content. We could 
consider increasing the demotion strength on content being demoted that is still breaking through into top 
posts. 

c. Background: 

i. We reviewed a recent report, titled Facebook has a vaccine misinfo problem, that concluded 12 of 
the top 15 vaccine-related posts on Facebook in a one-month period were “negative.” We 
replicated the report’s Crowdtangle search to review the content. None of the content or users 
relate to the “Disinfo Dozen.” Of note, in order to maintain the narrative of FB’s failure, our critics 
remove UNICEF content from their analysis because it effectively dominates covid content -- an 
accurate report on covid content from this Crowdtangle search would show that 5 of the top 15 
posts were authoritative, pro-vaccine posts from UNICEF. 

ii. None of the content should have been removed. Five pieces of content labeled “negative” are 
being demoted for being vaccine hesitant. Six pieces of content labeled “negative” are 
nor-violating -- one is an ABC News report; two are personal opinions opposing mask and 
vaccine mandates; and two are personal opinions about the speaker’s decision not to get 
vaccinated. Four pieces of content are labeled “positive” or “neutral.” There is a full content 
assessment below. 


= 


Detailed Assessment of Other Vaccine Hesitant Content: 
1. The #2 ranked content is an ABC News report about side effects. It is deemed “negative.” 
a. Delta assessment: We don't know whether the VWWH would propose that this reporting from 
network news should be removed for accurately reporting on side effects. We do not 
recommend doing so. 
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1. Five pieces of content (ranking 1, 5, 7, 13, 14} were borderline content and were demoted and labeled, but 
the demotion strength did not remove them from the top 100 FB posts for the relevant time period. All 
received the label: “COVID-19 vaccines go through many tests for safety and effectiveness and are then 
monitored closely” with a link to FB’s COVID-19 Information Center. 

a. Delta assessment {content assessment below}: We suspect the WH believes this content 
should be removed. We demote and label this content because we find it irresponsible in its 
sensationalism and lack of context; however, it is a mix of true content and criticism of the 
government, both of which are appropriate to allow on platform. 

b. #1, 5, and 7 are from Candace Owens and suggest that the vaccine is experimental or has side 
effects, including death, and are critical of the government. #5 was also fact-checked by a 
3PFC. 

c. #13 is from Tucker Carlson and offers sensationalized reporting on a true incident of a 12 year 
old suffering a rare side effect and and reporting on a study published in the Journal of the 
Amencan Medical Association (JAMA) Pediatrics about the dangers of wearing masks to 
children. The content was posted the day after the JAMA study was published. JAMA 
retracted the study two weeks after publication. 

d. #15 is from Turning Point USA and suggests that the government has no authority to mandate 
taking an experimental vaccine. 

1. Five pieces of content (ranking 4, 6, 8, 11, 12) were labeled negative. 

a. Delta assessment (content assessment below): The WH has previously indicated that it thinks 
humor should be removed if it is premised on the vaccine having side effects, so we expect it 
would similarly want to see humor about vaccine hesitancy removed. We don't have insight into 
whether the WH wants personal opinions about government mandates or explanations of 
personal choices not to get the vaccine removed. We believe there is a strong interest in 
protecting the expression of personal opinion and personal choice. 

b. #4 is a cartoon attempt at humor, suggesting that door-to-door vaccinators would be tied to 
trees. 

c. The other four pieces of content all offer personal opinions about mask or vaccine mandates or 
the decision to be vaccinated. 

1. Four pieces of content (ranking 3, 9, 10, 15} were labeled positive or neutral. 


Disinfo Dozen Status On Platform: 

1. We have been aware of the Disinfo Dozen back in March. We took very aggressive actions based on them, 
and other entities we flagged, by expanding the amount of Misindo that we remove and by giving the “Worst 
of the Worst’ entities 48 hours to remove all violating misinformation or otherwise they would be removed. 
AS a result of that, we removed known anti-vaxxers such as RFK Jr.’s IG Account. 

2. This resulted in behavior modification by these actors -- RFK stopped posting anti-vax content on his FB 
page, and some other members of the Disinfo Dozen also stopped posting violating content. 

3. We have continued to monitor these accounts and have found the following: 

a. 91 entities are tied to the Disinfo Dozen (however, the majority of these entities do not share anti-vax 
content and some post infrequently or stopped posting altogether). 

b. 23 of those entities have been removed. 

c. We are confirming additional entities (approx. 15) that may be removed under our “Single Use Multiple 
Account” and Recidivism policies (we are aiming to have these results by EOD). 

d. 11 of the 12 Disinfo Dozen members have had one entity removed by us. The 12th posts mainly 
about internet censorship now. We are watching his profile closely. 
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Exhibit 64 


Internal Facebook email 
correspondence 
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</O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=8E98834A8DAB4AA28B1A5C9OB9BE6C555> 


From: 


To: 
Sent: 7/23/2021 7:31:14 AM 
Subject: FW: Surgeon General 


e |f we were to blackhole all 28 websites, that would remove approximately 500 million pieces of content. 
e |f we were to blackhole only the 15 websites, that would remove approximately 252 million pieces of 
content. 
© |f we were to blackhole only the 2 domains where >50% of the recent shares contain violating content (i.e., 
childrenshealthdefense.org and vaccines.mercola.com), >66 million pieces of content would be removed. 
Are any of the 28 websites demoted (either RO or misinfo) 
Are any of those website links in the Top N? 


From: IS t2.com- 


Date: Thursday, July 22, 2021 at 3:17 PM 
To: eee mgr fb.com>, 


fo.con>, a’ 
fo.con>, iT’ ©fb.com>, ii 
SO %.con>, Ot com> 


Subject: RE: Surgeon General 


Thanks. I’m sharing this with Nick and the status on the label of the IG video. He’s calling Andy shortly. Thank 
you! 


From: fb.com> 
Sent: Thursday, July 22, 2021 12:13 PM 


7°: es >) com>; fb.com>: fb.com>; i 
i> com>; EE? fb.com>:; fb.com>: i 


2 —— 
__l fb.com>; nf. com>; (esi 
Se ———————— com>; ee com>; ii 


pt _tie com> 
fb.com>; Re com> 


a © 1. com>: 


Subject: Re: Surgeon General 


fb.com>; 


All — 
To follow-up on #2 below, we were able to evaluate the groups closer. Based on the evidence of the 
post showing an intent to evade enforcement, and the presence of strikes in the group, PLUS 


evidence that they have a back-up group ready to go if their larger group is removed, we are 
comfortable removing both groups. 
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Sent: Thursday, July 22, 2021 2:37 PM 


Subject: Re: Surgeon General 


On #2, we discovered this content in two groups. Both groups are using coded language to discuss COVID and 
vaccines. We don’t have a policy prohibiting people from using coded language if their content otherwise does 
not violate our policies. One group had only 6 posts and no violations; the other had 3,600 posts and 2 
violations. I am asking PREsc to continue reviewing those groups to make sure there are no violations. We 
could amend our Help Center to prohibit Groups and Pages from using coded language to discuss COVID 
and vaccines if there is evidence that they intend to avoid detection (we believe there is such evidence here 
-- see post below where they are teaching members how to use code words). 
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On #3, we reviewed 28 websites linked to the “Disinfo Dozen” and found that 15 prominently feature content 
that would violate our COVID/vaccine misinfo policies, or would be borderline vaccine discouraging, if they were 
on our platform. 


Of those 15, >50% of the recent shares of 2 of those domains would violate our policies if on platform; 25-50% 
of the recent shares of 6 of those domains would violate our policies; and <25% of the recent share of 7 of those 
domains would violate our policies. 


e |f we were to blackhole all 28 websites, that would remove approximately 500 million pieces of content. 

e |f we were to blackhole only the 15 websites, that would remove approximately 252 million pieces of 
content. 

e |f we were to backhole only the 2 domains where >50% of the recent shares contain violating content (i.e., 
childrenshealthdefense.org and vaccines.mercola.com), >66 million pieces of content would be removed. 


From: fb.com> 
Sent: Thursday, July 22, 2021 1:58 PM 


To: NE fb.com>; fb.com> - iim 


fb.com> 
Cc @fb.com>; TiS tb.com>: fb.com> fi 
fb.com> i fb.com>; fb.com> 


Subject: RE: Surgeon General 
Nick is pinging about this. Looks like the content in #1 still isn’t labeled. Can we get the label applied, content 
d, and tell him what he can say about why the label/demotion didn't happen in the ordinary course? 
it looks in the case like it's assigned to someone off-duty in Dublin. Can someone take the enforcement 
action? 


From: fb.com> 
Sent: Thursday, July 22, 2021 8:21 AM 


Ce: fb.com>; : : . 
fb.con> ED fb.com>; ED fb.com> 


Subject: Re: Surgeon General 


Just confirmed withllfiiinat (1) below is Tier 2 Borderline Vaccine content and should be labeled and demoted. I'll 
comment in the Case Jjstarted. 


Will also ask mm. look into (2). 


From: fb com> 


Date: Thursday, July 22, 2021 at 8:19 AM 
To: fo. com> iD (b.com> i 
fb.com>, fb.com>, is fb com>, 


ee iL). com> 
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ME @) fb. com>, fb.con>, 
MEE) fb.com>, fib.com> 


Subject: Re: Surgeon General 


fyi | sent the first IG link to | bit earlier. Being looked at in C#1001299. 


From: iS fb.com> 


Sent: , 2021 7:59 AM 
To: fb.com>; AE fb. com>; IES fb com>: 
fb.com>; fb.com>; ii ES fb.com> 

Cc: NED fb.com>; fo.com>; iE) (>.com>, Hii’ 


(>.> af >.co>; Ee) fb.com> 


Subject: FW: Surgeon General 


On the do-outs from Nick’s email below: 


1. https:/\www.instagram.com/p/CRbw8NEsOc6/?utm medium=share sheet Grateful if someone could 
explain why this wasn't labeled? 


| think this should be labeled per policy but can policy (MI confirm? And then product 
ME an follow up on why it didn’t happen and add the label? 

2. He also shared this which | think rather proves our point — are we supposed to remove “gibberish”? - but 
grateful for views since I'd like to get back to Andy on it (he claims he is trying to be helpful by passing on 
our POV to the Surgeon General before the Fri meeting): https://twitter.com/oneunderscore _/status 
/1418016654580199427?s=10 

°o | can't imagine we can find this stuff at scale, but is it possible to find this specific group so that we 
can review the content? And then maybe fan out via admins? One of the posts indicates that they 
consider themselves part of the disinfo dozen. I’m not sure who should own this —is there an ops 
partner running these reviews or is this product? 

3. Sheryl is keen that we continue to explore some moves that we can make to show that we are trying to be 
responsive to the WH. f- | have explained to her that you think the blackholing idea doesn't work after 
all. 

o | think we can go back to Nick in a matter of hours with more details on blackholing. We're trying to 
figure out if we can scope it to minimize removing benign content, but it’s not promising. 

nd are running that review. 


From: Nick Clegg <ncleqq@fb.com> 
Sent: Thursday, July 22, 2021 12:20 AM 


a. smaller group 


A few follow ups to our prep call yesterday plse following various threads: 


1. | think SS and | should primarily be in listening mode at the outset of the meeting with the SG not diving 
immediately into a back and forth on whose data is better, as per (MJ suggestion: “Look, we thought 
we were working well with you. Clearly, you believe something different. We hear you that you believe we are 
not doing enough. We'd love to better understand — specifically — where you think we are falling down, what 
specific types of misinfo we are missing (and the more specific examples they can give us the better we can 
go take it on), and we are here to listen, so we can move forward productively”. (| will probably also add a 
sharper tone to the way they have chosen to single us out over the last week!) 


By way of context, this is Andy Slavitt’s overnight advice on how to understand where the WH is coming 
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from: 
“Their logic trail that you should try to connect to is: 


-people deciding not to get vaccinated 
-what portion is due to misinfo? 
-what portion of them get that on FB? 


Millions of persuadable people getting bad info. All the good info seen by vaccinated people— not relevant. 
Other countries— not relevant. 


So they want to know how much misinfo is being seen by people. Until they can answer that they will be 
frustrated. 


Making a pledge to reduce the amount of misinfo unvaccinated people is all they care about. 
Whether you think this is the right approach or no, this is a reasonable way to look at things” 


2. Andy S has also provided this as an eg of unlabeled content which he says is doing the rounds and is being 
cited by a clinic in LA as one of the reasons why many people are not getting their second jab: 


https://www.instagram.com/p/CRbw8NEsOc6/?utm medium=share sheet 
Grateful if someone could explain why this wasn't labeled? 


He also shared this which | think rather proves our point — are we supposed to remove “gibberish’? - but 
grateful for views since I'd like to get back to Andy on it (he claims he is trying to be helpful by passing on 
our POV to the Surgeon General before the Fri meeting): 


https://twitter.com/oneunderscore __/status/1418016654580199427?s=10 


3. Sheryl is keen that we continue to explore some moves that we can make to show that we are trying to be 
responsive to the WH. Monika —! have explained to her that you think the blackholing idea doesn't work after 
all. 


We should take stock after the Fri meeting, but my sense is that our current course — in effect explaining 
ourselves more fully, but not shifting on where we draw the lines or on the data we provide (subject to the 
agreement last night that we'd offer up VP\Vs of content we've removed but only if demanded from other 
platforms on the same basis) is a recipe for protracted and increasing acrimony with the WH as the 
vaccine roll out continues to stutter through the Fall and the Winter. Given the bigger fish we have to fry with 
the Administration — data flows etc — that doesn't seem a great place for us to be, so grateful for any 
further creative thinking on how we can be responsive to their concerns. 


THx 
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Exhibit 65 


Internal Facebook text thread 
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From: /O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 


/CN=8E98834A8DAB4AA28B1 A5COB98BE6C555> 
To: : 


Sent: 7/23/2021 2:00:43 PM 


Subject: Message summary [{"otherUserFbld":null, "threadFbld":4183011125113768}] 
Attachments: sticker.png 


«8 23/2021 07:16:58 PDT): 

>hello friends. i Rab ‘aught up quickly with GM anc he had one question on the domains 
following your note yasteniay a Do we have any information on how many of the domains 
are being demoted by things like RO or other policies? 


222021 07:20:03 evr): 


>If we haven’t already gotten it, I think it’1l be | that has that info. 


(P/23/ 2021 OF: 20218 PDT): 
, ado you know if it’s in the big chart? 


I (7/22/2021 07:20:30 evr): 


-I am looking at the big chart right now and am not seeing it 


a (7/23/2021 07:20:32 PDT) : 


Big chart being a technical term. 


ks 21 07:20:40 PDT): 


Let me ask who's been working on it 


Ss «7 23/2021 07:21:27 PDT): 


>thank you —- let us know however we can help if we need to ask for it 


2222021 07:25:11 evr): 


don't have this data but that he will work on getting it 


~] 


{23/2021 07:24: Si? PHT): 
; could help with this? It’s not our data so a little odd for E | to be going 
thru us. I’m kinda confused. 


7/22/2021 07:25:17 PDT): 
>I thinkQMJ is going to reach out to Ky 


>he wasn't going through us - he and i were just chatting b > the SG meeting and he 


efo 
raised it and i wanted to check it hadn't eee been pulled 


>so was just me checking and clarifying that it was his idea 


>So this is tracking the disinfo dozen’s off-platform domains on platform? 


MS (7/23/2021 07:27:41 ppt): 

>yes — call me if easier to just chat through? 

es (7/23/2021 10:02:07 PDT): 

>From ———— ee 7 am sure others have seen): 
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>— There are 3 domains associated with the Disinfo Dozen that are currently in Misinfo RO 
status and jing reduced distribution 
Mercolal[.c 75% demotion, expires 


>- Childrenshe thdefense[.org] 50% demotion, expires 10/1 
>—- Greenmedinfo 


5 
-com] - 60% demotion, expires 10/€¢€ 
fn 


3/2021 10:11:40 PDT) 
SG covid Response XFN reaantioat T 


— je 


04:06 PDT): 
ve passed this onto guy but can we put in the big chart too? 


10:14:45 PDT): 
table/canonical thing. not chat. sorr 


GS 7/23/2021 12:28:42 PDT): 
>hi pals me again. ME asked if we could include the actions that we took against the DD 
this week in the note back to the SG - would someone be able to give me those? 


WE 7/23/2021 12:29:03 por): 
> s the draft note: https://docs. google. com/document/d/1GuSdoAmW3xhm6HU5u_JKxhbG1t rZ- 
sjkY81KL5hASb8/edit 


about to hop onto an external call for the next hour but can pull after that if not 
late. 


(23/2021. 22:307:02 PDT): 
working on pulling this together 


7232021 12:30:08 PDT): 


>Is it net-new enforcement this week or a summary of hte enforcement? 


ME 22/2021 12:30:09 por): 


>thank you so much 


Z1. A123 S0814 PBT): 
k 


net new 


es 23/2021 12:31:06 PDT): 
Let me know if I can help then, Ei 


(7/23/2024 '12331:28 PDT): 
>Ok, I will have them reach out to you 


es 07/23/2021 12:32:00 PDT): 
if it's possible to get in the next hour that would be great a? wanted to ship the 
note before ~2pm PT 


er. ft 


>We're working on fetitlrie that right now 


222021 13:35:30 PDT): 


>Not sure how impactful it is -- take a look 


(owaaten! (7/23/2021 13:52:18 PDT): 
: y° - Are we goo ae) 7 st Ss it 


or not, 


922 2021 13:53:35 PDT): 
>I mean, nothing we say will be persuasive to that crew...but make sure it doesn't detract 
from the message 
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| 
n 
J 
al 
4 


>I thought it did! 


(7S23/ 20271 13253246 PDT): 
>But I don’t know if I have any say in it 


J J 
bh y 
4 » 
nS > 
& ne 
is 
te 


13:54:51 PDT) ; 
>Do we also need to add in the claims we added to ones that we are removing? Or is that not 


that helpful? 


1 13:55:28 PDT): 
>I don't think it's that helpful, in my mind 


CS 7/23/2021 13:56:02 PDT): 


>Can you remind me what it was? 


7/9 AKA 
(7/23/202 


J 


saying we will remove claims that the vaccine causes 


>it was approx 4 claims ve 
in you getting sick from their 


magnetism, that standing next to someone will result 
vaccine, and other sort of kooky stuff 


(T/2Z372021 13357340 EDT): 
>We could say, blandly, "We s the group of false claims that we remove from our 


platform, to keep up with rec 


of misinformation that we are seeing." 


(7/23/2021 13:57:50 PDT); 


mething like that 


oO 
rR 
H 
oO 


~] 
b 

~ 
W 
aw 
ci 

bo 
< 

ba] 
© 
yy 


-Great 


CS 7/28/2021 13:58:30 PDT) 


>Thank you so much 


=} 
r 
WwW 
BS 
OQ 
NS 
ran 
nay 
e 
CS 
Rw 
rm 
eo 
4 


>Added in. 
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Exhibit 66 


Internal Facebook email 
correspondence 
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From: <0 = THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=BRANDIHB3D8> 


To: Nick Cle 

cc: 

Sent: 7/24/2021 2:44:37 PM 

Subject: Re: US/Canada comparison - WH Press Briefing 


Thanks, Nick. We completely agree. We had some success this week doing hand-to-hand combat with reporters 
on the work we've done on the ‘disinfo dozen’ and got the actions we’ve taken into a good portion of the coverage. 
That being said, the President himself raised these individuals twice this week — once in the Monday statement he 
made walking back his ‘killing people’ comment and again at the CNN Town Hall on Wednesday night. So, we 
clearly need to rebut this claim more strongly. 


We originally considered writing a letter to the org who is the source of this list — the Center for Countering Digital 
Hate. We ultimately decided that doing so would only elevate the org and get us into a letter writing back-and-forth 
that would prompt more negative press cycles for us. Instead, we have drafted a newsroom post to serve as the 
‘one stop shop’ for the actions we've taken against the ‘disinfo dozen.’ We are working at the XFN level to sort out 
some final stats and are planning to circulate that post to you and others in leadership for feedback on Monday 
morning. 


Of course, we're still in a tough spot as the WH’s case — while wrong — is very simple: 12/)people are responsible 
for the vast majority of the anti-vaccine content on Facebook and they’re (almost) all sti i n the platform. 
Our response is more complicated. | doubt there’s buy-in for this, but treating some of th€se people as we do 
Dangerous Orgs and Individuals is the only approach | can think of that would hri er in line with the 
media/VWH/policy elites view that we should be banning people who repeatedly k oUr rules from all of our apps. 


As anext step, we'll follow-up with the newsroom post early next week. ‘@) 


Q 


Many thanks, 


From: Nick Clegg Gof com> 

Date: Saturday, July 24, 2021 at 9:40 AM 
To: 
Ce: 


ubject: Re: US/Canada n - WH Press Briefing 


THx - one othe as pondering was how/whether we should be more assertive in dismissing this 
endlessly repeated me f “12 people account for 65/75% of all misinfo on FB"? As EEE (both added 
here) and | explained to th@ Surgeon General yesterday NOT ONE SINGLE post in the top FB 100 posts listed in 
the reports we have submit to the Administration over the last several weeks are in any way associated with the 
“disinfo dozen’. Of course, we're at risk of mixed messaging because we are simultaneously telling people about 
all the action — including this week — that we are taking against their content on our apps, but I'd be grateful for any 
thoughts you and the team might have about how we can more forcefully contextualize a claim which really has 
taken a life of its own. 


N 
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From: iS 1p .com> 


Date: Friday, July 23, 2021 at 11:05 PM 


To: Nick Cl fb.com> 
Ce: fb.com>, 


Subject: US/Canada comparison - WH Press Briefing 


Mfb.com> 


Nick, 


| wanted to share a clip from today’s WH Press Briefing where Psaki was asked about the disparity in vaccination 
rates between the US and Canada. Psaki pointed to the raw number of vaccinations in the US and didn’t engage in 
speculation as to why Canada’s vaccine rollout is moving faster than the US effort. We're continuing to explore 
avenues to get this comparison into the conversation over the coming days. 


Many thanks, 


Reporter: “Is there something to be learned from our neighbors to the north, Canada? They got a much slower 
start. They didn't have nearly as many vaccines as we did early on. And yet now they’ve shot past us and 70% of 
their population is at least partially vaccinated. What's the difference between the two countries? What can we learn 


We're the first to say, and we have long said that, that's not enough. We need to ensure More people and more 
communities are vaccinated. And it is now, we've reached a point where there are mmunities, even states 
where there's 70%, 80% or higher vaccination rates. Other communities where t 0%, 50% or otherwise, 


that's not just a health issue. It's a huge health issue. It's an economic issye™WVe've Seen how that can impact local 
tee 


from their experience?” 
Jen Psaki: “Well first, | would say 162 Million Americans are now vaccinated. That ated positive step. 


communities as it may lead to shut downs of different businesses - It's a omic issue as well. So of course 
we work in close partnership with our neighbors, but we have 162 Millfon cans vaccinated. We're the world's 


largest provider of vaccines to the global community. That's progréssNin our view, even as we've said from the 
beginning there’s more work to be done.” 


O 
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From /O=THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 

To: 

Sent 7/27/2021 7:14:30 AM 

Subject: FW: Ok to send? 


From: Nick Clegg Go com> 


Date: Monday, July 26, 2021 at 10:07 AM 
To: ES fb. com>, fb.com> 
Cc: EEE b.com>, fo.com>, iii 


EEE © fb.com> 
Subject: Re: Ok to send? 


Ok thx — will tweak and send. 


aaa can | suggest you check with MBs team (and iii re the ongoing wellbeing research 


worstream? | haven ‘t been following it too closely — Tim may know more — but my impre is they are really 
stepping up their wellbeing research activity which may be a v good thing to share with hy his team. 
Thx 

N 

From: i@fb.com> ‘@ 


Date: Monday, July 26, 2021 at 2:17 PM 
To: Nick Clegg fab. com> fb.com> 


Cc fb.com>, fo.com>, iii 


fb.com> 
Subject: Re: Ok to send? 


No-| agree that adding specific reference to the afore is important as | think this will continue to be a 
sticking point for us. Other than that looks goo 


Get Outlook for iOS 
From: Nick Clegg > fb.com> 


Sent: Monday, July 26, 2021 7:45: 
70: RIES .com> 
Cc fES fo.com> com>; 
SEE 10.com> 


Subject: Re: Ok to send? 


Good point — I'll also add that he specifically called out the need for them to understand what the “denominator” is 
in our stats as that was fairly pointed from him. 


| Oe any other thoughts before | revise and send? 


N 
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Date: Monday, 
To: Nick Clegg 


Subject: Re: Ok to send? 


One thing Dr. Murthy mentioned at the end — perhaps worth including as a signal of things to come? —is an broader 
concer from a wellbeing perspective. He talked about how he travels the country and hears concerns from people 
and questions about about whether social media is bad for kids, and how this current health misinfo issue is the 
first one to figure out for the industry. 


From: Nick Clegg J @fb.com> 
Sent: Monday, July 26, 2021 12:43:23 PM 


(>co> i S '>.<o>; T 


Guy, | & any comments on this short email update I'd like to send to MZ/SS: 


“Mark, Sheryl ( } 


i: | met with Surgeon General Murthy on Friday. Quick readout: 


e Whilst the tone was constructive and Murthy was keen to stress that he to“avoid further public point 
scoring, he was nonetheless clear that he wants us to do more. He asked fofyan update on our future 
“product roadmap” re Covid by the end of this week. | explained en aback we were by the rhetorical 
attacks from POTUS/the Administration. Murthy said he understo@d why we felt affronted. 


e We did not respond to the request for a product update next week, suggesting instead a deep dive on data 
measurement with his data team since much of the substantive discussion dwelt, once again, on the delta 
between their reliance on Crowdtangle/engagement, data (and/or data derived from Crowdtangle by third 
party groups, notably the Center for Countering ital Hate who generated the “disinfo dozen” stats which 
have been used repeatedly by the VWWH) and o S on reach/views (we provide a bi-weekly report to 
the Surgeon General on top 100 FB posts i ). 


e We also emphasized that any further data will be asked to provide (eg VPVs for covid content we 
have removed) must be requested r platforms too, notably YT and TT. | have repeated this in writing 
to Murthy since. 

e Murthy stressed that the concern he his team have is the misinfo consumed by specific groups of users, 
not FB users in general. Their concern is with a hard core of vaccine hesitant US citizens who don't see or 
believe in our authoritative Covid content and only consume misinfo which is intensely shared between them. 


e | have proposed to Murthy that we establish a regular cadence of meetings — either with him or at staff level 
— in order to work through these issues and avoid where possible another public collision. Our approach 
throughout will aim to: a) increase convergence on how we measure and tackle Covid misinfo; b) minimize 
expectations of major further product or policy shifts on our part (we haven't been able to identify any to 
date); c) reduce the pressures on further public blowups. 


Happy to provide any more detail if needed. 


N” 
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ME - = 1 HE FAcEBOO K/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 


From: 
/CN=8E98834A8DAB4A428B1A5COBISE6C555> 
To: 
Sent: 7/26/2021 10:19:46 AM 
Subject: Re: US/Canada comparison - WH Press Briefing 


Np! Thank you, this 1s helpful 

From: i oi) com> 

Date: Monday, July 26, 2021 at 1:15 PM 
SO — ee 


Subject: FW: US/Canada comparison - WH Press Briefing 


So sorry —!1 should have copied you on this! 


From fb.com> 
Date: Saturday, July 24, 2021 at 2:44 PM 


To: Nick Cle fb.com> 
fb.com>, Dfb.com 
Subject: Re: US/Canada comparison - WH Press Briefing 


Thanks, Nick. We completely agree. We had some success this week doing hand-to-hand combat with reporters 
onthe work we've done on the ‘disinfo dozen’ and got the actions we’ve taken into a good portion of the coverage. 
That being said, the President himself raised these individuals twice this week — once in the Monday statement he 
made walking back his ‘killing people’ commen: and again at the CNN Town Hall on Wednesday night. So, we 
Clearly need to rebut this claim more strongly. 


We originally considered writing a letter to the org wno is the source of this list — the Center for Countering Digital 
Hate. We ultimately decided that doing so woud only elevate the org and get us into a letter writing back-and-forth 
that would prompt more negative press cycies for us. Instead, we have drafted a newsroom post fo serve as the 
‘one stop shop’ for the actions we’ve taken against the ‘disinfo dozen.’ We are working at the XFN level to sort out 
some final stats and are planning to circulate that post to you and others in leadership for feedback on Monday 
morning. 


Of course, we're still ina tough spot as the WWH’s case — while wrong — is very simple: 12 people are responsible 
for the vast majority of the anti-vaccine content on Facebook and they’re (almost) all still active on the platform. 
Our response is more complicated. | doubt there’s buy-in for this, but treating some of these people as we do 
Dangerous Orgs and Individuals is the only approach | can think of that would bring us closer in line with the 
media/WH/policy elites view that we should be banning people who repeatedly break our rules from all of our apps. 


As anext step, we'll follow-up with the newsroom post early next week. 


Many thanks, 


From: Nick Clegg 4 @fb.com> 
Date: Saturday, July 24, 2021 at 9:40 AM 
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; , fo.com>, 


fb.com>, ii i .com>, 


Subject: Re: US/Canada comparison - WH Press Briefing 


THx li - one other thing | was pondering was how/whether we should be more assertive in dismissing this 
endlessly repeated meme of “12 people account for 65/75% of all misinfo on FB”? As both added 
here) and | explained to the Surgeon General yesterday NOT ONE SINGLE post in the top FB 100 posts listed in 
the reports we have submit to the Administration over the last several weeks are in any way associated with the 
“disinfo dozen”. Of course, we're at risk of mixed messaging because we are simultaneously telling people about 
all the action — including this week — that we are taking against their content on our apps, but |’d be grateful for any 
thoughts you and the team might have about how we can more forcefully contextualize a claim which really has 
taken a life of its own. 


N 


Fron i 21> com> 
Date: Friday, July 23, 2021 at 11:05 PM 
To: Nick Cle fb.com> 


Subject: US/Canada comparison - WH Press Briefing 
Nick, 


| wanted to share a clip from today’s WH Press Briefing where Psaki was asked about the disparity in vaccination 
rates between the US and Canada. Psaki pointed to the raw number of vaccinations in the US and didn't engage in 
speculation as to why Canada’s vaccine rollout is moving faster than the US effort. We're continuing to explore 
avenues to get this comparison into the conversation over the coming days. 


Many thanks, 


Reporter: “Is there something to be learned from our neighbors to the north, Canada? They got a much slower 
start. They didnit have nearly as many vaccines as we did early on. And yet now they’ve shot past us and 70% of 
their population is at least partially vaccinated. What's the difference between the two countries? What can we learn 
from their experience?” 


Jen Psaki: “Well first, | would say 162 Million Americans are now vaccinated. That certainly is a positive step. 
We're the first fo say, and we have long said that, that's not enough. We need to ensure more people and more 
communities are vaccinated. And it is now, we've reached a point where there are some communities, even states 
where there’s 70%, 80% or higher vaccination rates. Other communities where there’s 40%, 50% or otherwise, 
that's not just a health issue. It's a huge health issue. It's an economic issue. We've seen how that can impact local 
communities as it may lead to shut downs of different businesses - It's an economic issue as well. So of course 
we work in close partnership with our neighbors, but we have 162 Million Americans vaccinated. We're the world's 
largest provider of vaccines to the global community. That's progress. In our view, even as we've said from the 
beginning there's more work to be done.” 
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From:  </0= THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Waldo, Eric oo GE 2 0 stp.cop.gov; Du Patil 
cc: 


Sent: 8/17/2021 2:27:28 PM 
Subject: Re: Follow up - data discussion 


Hi DJ—hoping to get follow up time scheduled so that we can cover the landscape on data that we had discussed 
during our call with the Surgeon General—as we continue to think through on our end how we can be more 
transparent around vaccine content, it would be very helpful to make sure we are working from the 
understanding. Can we find time for our teams to get together soon? 


Get Outlook for 10S 


From: fb.com> 
Sent: Friday, August 6, 2021 9:02: 


To: Waldo, Eric (HHS/OASH) , ov>; R60 sto.cop.gov 


< gmail.com> 


ostp.eop.gov>; DJ Patil a. 
Co fb.com>; Nick Clegg <i fb.com> 


Subject: Re: Follow up - data discussion 


Thanks Eric, 


Appreciate you connecting us to DJ here—anc look forward to scheduling time for a longer conversation around 
data per our last meeting. DJ—let me know what would work best on your end. Our teams have been working on 
additional steps—we will have something back to you within two weeks outlining our approach. 


Also including our latest bi-weekly report, which shows the top 100 most viewed overall posts on Facebook in the 
US. as well as the top vaccine related posts on Facebook in the US for the weeks of 7/11 - 7/17, and 7/18 - 7/24. 
Please distribute to whomever on the team might be interested, and let me know if you or anyone on the team has 
any questions. 


Get Outlook for iOS 


From: Waldo, Eric (HHS/OASH) <a nns. gov> 


Sent: Friday, August 6, 2021 4:07 PM 
To: ostp.eop.gov; DJ Patil 
Ce: Nick Clegg 


Subject: RE: Follow up - data discussion 


_ 


Hope your week has been going well. | wanted to loop DJ in on his gmail (where you may get a faster reply) on 
next steps for connecting about data. 


Also Bend Nick—I know on the call with Dr. Murthy he’d mentioned seeing if you were able to send an update 
of any new/additional steps you are taking with respect to health misinformation in light of the advisory. We are 
asking all platforms for this type of update. Would you be able to send something over within two weeks? 


Thanks so much, 
Eric 
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From: fb.com> 


Sent: Wednesday, July 28, 2021.9:20 PM 
To: Waldo, Eric (HHS/OASH) < 
Cc: TT © fb.com> 

Subject: Re: Follow up - data discussion 


ths.gov>; ES ostp.eop.gov 


Eric—making sure you saw this as well, as | know there’s been a lot of attention directed toward vaccination 
mandates in recent days. Happy to connect on this front if helpful. 


“As our offices reopen, we will be requiring anyone coming to work at any of our US campuses to be vaccinated. 
How we implement this policy will depend on local conditions and regulations. We will have a process for those 
who cannot be vaccinated for medical or other reasons and will be evaluating our approach in other regions as the 
situation evolves. We continue to work with experts to ensure our return to office plans prioritize everyone's health 
and safety.” - Lori Goler, VP, People 


From: Waldo, Eric (HHS/OASH) <i nhs. gov> 


Date: Wednesday, July 28, 2021 at 5:42 PM 


, ostp.eop.gov 


Subject: RE: Follow up - data discussion 


Really appreciate it. 


From: fb.com> 
Sent: Wednesday, July 28, 2021 5:41 PM 

To: Wako, Eric (HHS/OASH) (iO ths cov>; IG osto.cop.gov 
Ce: fb.com> 

Subject: Re: Follow up - data discussion 


Got itthanks Eric, completely understand why you would have been a little busy this week! Will stand by, and will 
continue to be in touch as things develop on our end as well. 


Get Outlook for iOS 


From: Waldo, Eric (HHS/OASH) <M @hhs.gov> 


Sent: Wednesday, July 28, 2021 5:34:16 PM 


To: fo.com> IMS osto.cop cov <M ostp.eop.qov> 


Ce: fbh.com> 
Subject: RE: Follow up - data discussion 


Hey 


Thanks for your patience. The CDC updated guidance has kept us pretty busy this week(!}. Appreciate these 
additional materials. 


I'll circle back with more, but appreciate you understanding. [Also, DJ is out on leave for the rest of this week, so 
trying to sync calendars]. 


All the best, 
Eric 
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From: fb.com> 

Sent: Wednesday, July 28, 2021 1:16 PM 

To: Waldo, Eric (HHS/OASH) <0 ths.cov>; ND osto.cop.gov 
Subject: Follow up - data discussion 


Hi Eric and DJ, 


We're looking forward to our next meeting, where we are hoping to do a deeper dive on how we are measuring 
data and what steps we might be able to take to address concerns you've raised. 


In the meantime, | wanted to make sure you have our response to the Washington Post piece from yesterday 
(linked here) that made certain claims based on survey data. Hoping this might be a useful addition to our 
conversation, along with making sure we cover the statistics put forward by the CCDH that have been cited by the 
White House regarding the cisinfo dozen. 


The statement is below—look forward to discussing next steps at your earliest convenience. 


"The sensationalized, overstated findings of this research are not supported by what the authors report to 
nave measured. It is unclear what their overall sample represents with respect to generalizability to the US 
population. For example it shows Fox News and CNN have the same size of audience. which they do not. 
Moreover what they claim as ‘Facebook users’ is a non-representative idiosyncratic subset of the Facebook 
population. These are examples of how their data is biased to start with and that matters when attempting to 
make these claims. The authors claim that people who rely on Facebook to get news and information about 
the coronavirus are less likely than the average American to be vaccinated. But this isn't valid without 
describing a representative sample of the American population, Facebook users, or measuring reliance 
instead of mere self-reported expcsure over a short time window. What this data and methodology does 
suggest is that people who nave net yet been vaccinated are less reachable by CNN, MSNBC, or the Biden 
Administration than on Facebook. making our ongoing efforts to share authoritative information and 
encourage vaccine uptake more important than ever.” 


1 o 


From: fb.com> 

Date: Tuesday, July 27, 2021 at 8:15 PM 

To: (HHS/OASH) <f@nhs.gov> 
Ce: fb.com=> 

Subject: Re: Message from Nick Clegg 


Hi Eric—just checking at the end of the day. I’m sure you're swamped. Making sure we don't let too much time 
pass before getting back together with you and DJ, and whomever else might make sense. 


Date: Monday, July 26, 2021 at 2:54 PM 
To: Waldo, Eric (HHS/OASH) <{ii—ianns.gov> 
Subject: Re: Message from Nick Clegg 


Fric—let me know if if makes sense fo sync on next steps? Would love to move forward with the meetings we 
identified as next steps as soon as your team is ready. 
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From: iE of com> 


Date: Friday, July 23, 2021 at 11:20 PM 

To: Nick Clegg fo.com>, Murthy, Vivek (HHS/OASH} hhs.gov> 
Ce: ——— Sa Waldo. Eric (HHS/OASH) = one 
Subject: Re: Message from Nick Clegg 


Including this week’s updated report here. Look forward to scheduling our next working session. As always please 
let us know if you have any questions. 


From: Nick Clegg fb.com> 
Date: Friday, July 23, 2021 at 7:29 PM 


To: Murthy, Vivex (HHS/OASH) < hhs.gov> 
Ee! com> fo.com>, Waldo, Eric (HHS/OASH) 


hhs.gov> 
Subject: Message from Nick Clegg 


Dear Vivek (if | may}, 


Thanks again for taking the time to meet earlier today. It was very helpful to take stock after the past week and 
hear directly from you and your team, and to establish our next steps. 


We talked about the speed at which we are all having to iterate as the pandemic progresses. | wanted to make 
sure you saw the steps we took just this past week to adjust policies on what we are removing with respect to 
misinformation, as well as steps taken to further address the “disinfo dozen’: we removed 17 additional Pages, 
Groups, and Instagram accounts tied to the disinfo dozen {so a total of 39 Profiles, Pages, Groups, and IG 
accounts deleted thus far, resulting in every member of the disinfo dozen having had at least one such entity 
removed). We are alse continuing to make 4 other Pages and Profiles, which have not yet met their removal 
thresholds, more difficult to find on our platform. Ve also expanded the group of false claims that we remove, to 
Keep up with recent trends of misinformation that we are seeing. 


We hear your call for us to do more and, as | said on the call, we're committed to working toward our shared goal 
of helping America get on top of this pandemic. We will reach out directly to DJ to schedule the deeper dive on 
how to best measure Covid related content and how to proceed with respect to the question around data. We'd 
also like to begin a regular cadence of meetings with your team so that we can continue to update you on our 
progress. You have identified 4 specific recommendations for improvement and we want to make sure to keep 
you informed of our work on each. 


| want fo again stress how critical it is that we establish criteria for measuring what’s happening on an industry-wide 
pasis, not least to reflect the way platforms are used interchangeably by users themselves. We believe that we 
nave provided more transparency, both through CrowdTangle (the flaws of which we discussed in some detail) and 
through our Top 100 report, than others and that any further analysis should include a comprehensive look at what’s 
nappening across all platforms--ours and others — if we are going to make progress in a consistent and sustained 
manner. 


Finally, we will be sending you the latest version of our Top 100 report later today, per our regular schedule. Brian 
will do the honors this week as it will likely be completed at our end later today East Coast time. Ve really do hope 
that we can discuss our approach to this data set in greater detail during our next session with DJ, as we genuinely 
delleve it is an effective way of understanding what people are actually seeing on the platform. 
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Once again, | want to thank you for setting such a constructive tone at the beginning of the call. We too believe that 
we have a strong shared interest to work together, and that we will strive to do all we can to meet our shared goals. 


Best wishes 


Nick 
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From: /O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=8A7030791971 54AFS9F82CFF2CE7AD656> 

To: 

Sent: 8/2/2021 4:02:30 PM 

Subject: FW: To Review: Disinfo Dozen stats and newsroom post 


(FYI re the latest on data for CCDH response) 


From: i  tb.com- 
Date: Monday, August 2, 2021 at 3:33 PM 
fp. com> 


Ofb. com>, 


fp.com>, Nick Cl legg 


lan <joelkaplan@fo.com>, 


©. 01>, ETS fb .com> 


Qfb.com> Qfb.com>, @fb. com> iy 
fb.com>, fb.com>, (SR Comms) 


BE @fb.com> 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


- 
We aid a follow-up analysis per your suggestion, to get an early directional sizing on whether (and how much of} 
the information associated to the dozen domains is classified as misinformation according to our policy. 


We took the Top 100 by VPVs among all content on FB linked to the disinfo dozen {both content directly posted by 
one of these entities, as well as link shares from domains associated with them}, between 4/22 and 7/22, in US, 
and our policy experts on M&H and 32V [ii ec spectively) manually labelled them. 
We found that 14/100 were M&H, 42/100 were B2V, and 25/100 were labeled by 3PFC (4 False, 5 Partly False, 
and 16 Missing Context}. 


Based onthe above, we cannot assert that 9M VPVs is a major over-estimation of vaccine misinformation from 
the disinfo dozen on our platform. We can still assert that 190M ts an under-estimation of all vaccine misinfo on 
our platform, since it only captures worst-of-the-worst. 


We are working with Comms and Policy ae: the appropriate language to use in the NRP, but wanted 
to share this update early to get your feedback. 


From: ES fb. com> 


Date: Thursday, July 29, 2021 at 10:49 AM 


fb.com>, Nick Clegg 


_ 
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fb.com>, iii 


(SR Comms) 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


We need to really focus on URLs here, | think the account based approach is not sufficient, unless we use the 
accounts to identify additional domains that we want to consider associated. | also want to reiterate we need to 
focus on proportion of misinformation, not all content. 


We still need to clarify if the information assoc‘ated to the dozen domains is classified as misinformation 
according to our policy. 

Top N from the domains - are they properly labeled as vaccine related? 

Look at top N vaccine related - manually review as M&H, B2V, 3PFC false or neither 


One very hacky solution to this problem which I think may work. please check this logic: “~9M VPV¥s of total vaccine 
related content for associated URLs (need to double check content classifier 1s gettmg this right). The absolute minimum 
number of violating VPVs during this period (from content we deleted for violatng M&H policy) was [80M. If we assume 
all YM to be misinformation and only 190M total misinformation. at most 5% of misinformation was from this group. 
However, this 1s believed to be a major over estimation. b/c only a fraction of the 9M VPVs were potentially perceived to 
be misinformation (for example. here are the top 10 URLs. only X are potentially percetved to be misinformation) and we 
acknowledge not all violating misinformation was deleted nor is all potentially perecived misinformation covered by our 
M&H Policy. We don't know the exact figure here. but our estimate is this is far cleser te zero than 4%." We don't need te 
sav all this. but we could use this math to backup a qualitative statement 


What we could say: “views of covid misinformation we removed from the 12 disinformation dozen entities 
is fess than 7% of views on covid misinformation we removed” 
e | think the problem here is entities vs URLs, and further, we don’t know the recall of our removals wrt to the 
misinfo dozen 


What we could say: “views of any and all content (misinformation, hesitancy or totally benign) from the 72 
disinformation dozen in the US is a thousand times times smaller relative to views on all covid or vaccine 
related content in the US on the platform.” 
¢ |'d probably use a % here. For clarify this is ALL content from the URLs from the dozen or associated 
entities? | do like this comparison for framing, It just doesn't directly refute the complaint. 


From: fb.com> 
Date: Wednesday, July 28, 2021 at 6:22 PM 
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(SR Comms) 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


Thank you for your feedback on the struciure of the Newsroom Post. Responding below to your 4 points: 


1. Explain the methodology taken by this report. 

1. We will work with comms and UXR to edit the NRP with the methodology and our refutations 

2. Details on the methodology and the issues are below as background for you (thanks to | ee 
pulling this}. 

2. Refute the methodology as being a bad approach, being non-representative, circular (the groups 
focus on the dozen, and the dozen focuses on these groups) and undermining the complexity of the 
misinformation ecosystem and challenges we face {I like this b/c it’s being a bit vulnerable and open, 
hopefully helping with credibility). 

1. The CCDH report claims to have ‘analysed a representative sample of 483 pieces of anti-vaccine 
content”. The selection of the content was based on 30 groups (20 public, 10 private} and content 
posted between 2/1 and 3/16. The report does not include the criteria under which these groups were 
chosen and there Is no evidence to suggest that their sample of groups or content from those groups 
are generalisable, or that the content shared in these groups is representative of the Facebook 
content ecosystem. 

2. The CCDH then coded the contert based on whether it was from the disinformation dozen or net and 
looked at the number of times disinfo dozen content was posted or re-shared, relative to the rest of 
their sample, and then produced the claim that 73% of vaccine misinformation on Facebook is coming 
from those 42 individuals. 

3. The numbers they are using for prevalence do not represent reach or VPVs on the platform. They 
looked at numbers of posts and shares of URLs in their original sample. 

3. Acknow ledge {if true} the report did find the dozen was responsible for these 30 groups, buf 
reference back to limitations as defined in {2} and that this is being misappropriated to a generalized 
understanding of online misinformation. 

1. To follow (as above) 

4. Explain the role these 12 actors are playing in misinformation on FB. 

1. On substance and to better explain the role these 12 actors are playing in misinformation on FB, we'd 
propose reorienting around two main parts of the narrative backed up by data. Rather than using 
3PFC ratings by these 12 individuals as the definition of misinformation, we are proposing we use 
content removed for violating Covid M&H. 

2. Measuring this “known” amount, we have found: 

1. First, VPVs attributed to the Disinfo Dozen are responsible for well under 1% of overall Misinfo 
& Harm violating content (e.g., they are responsible for a minimal amount of what we consider 
the “worst of the worst” content on the platform). Specifically, between 4/22 and 7/22, in US, 
~78k pieces of FB content (~45k on IG) were removed for M&H violation in total. VPV impact: 
~178M FB {(~38M IG). Of these, 3 pieces of content (23 on IG) were produced by entities {~90) 
linked to the disinfo dozen, having 500K VPV (14M VPVs on IG). 

1. Pros: 
1. Easier to validate. 
2. Cons: 
1. Assumes we are effective at enforcing all violating content. 
2. Does not include nor-violating hesitancy content. 
3. Does not include domain link shares. 
4. Could be perceived as we remove less content or our policies are too strict 
3. Time to validate: under a week 
4. What we could say: “views of covid misinformation we removed from the 12 
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disinformation dozen entities is less than 7% of views on covid misinformation we 
removed” 

2. Second, VPVs attributed to the Disinfo Dozen are responsible for a small percentage of all 
conversations across our platforms about COVID and the Vaccine, regardless of violating 
Status. Specifically, we'd show that between 4/22 and 7/22, these Disinfo Dozen entities 
produced 2M vaccine VPVs in the US {if you include domain link shares, SM VPVs}, versus 
15B across US Vaccine VPVs in these 3 months (accounting for 0.06%). 
[RECOMMENDATION] 

1. Pros: 

1. Includes domain link shares. 

2. Cons: 

1. More resource intensive to validate, since (1) this measurement of link shares is 
based on non-standard data infra, and {2} we need to vet the accuracy of our 
vaccine classifier. Requires significant engineering and data science effort, most 
aggressive estimate is ~2 weeks for validation of stats. 

3. Time to validate: 2 - 3 weeks {entirely unchartered validation and complex to do) 

4. What we could say: “views of any and aif content (misinformation, hesitancy or 
totally benign) from the 12 disinformation dozen in the US is a thousand times 
times smaller relative to views on all covid or vaccine related content in the US on 
the platform.” 

5. Potentially share one or both of above. 
1. Our recommendation is to share 4.b.ii 
6. If possible speak to prevalence of vaccine misinformation on FB, less relevant to the story at hand, 
but helps us with the next story. 
= 1. We will send a separate note on this shortly 


From: fb.com> 
Date: Wednesday, July 28, 2021 at 9:21 AM 
To: 


fb.com>, 
a@tb.com>, OTD.cam>, 


fb.com>, Nick Clegg 4 @fb.corn>, 
Efb.com>, ii” 


@fb.com>, fb.com>, i 
com>, 


tb. SR Comms) <@fb.com> 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


We have a call later today —: team (and i to align on this and can send another update this 
S points 


afternoon in response to 


Get Outlook for iOS 


From: SES fo.com> 


Sent: Wednesday, July 28, 2021 12:05:30 PM 
To: i @{b.com>, 

BE). com>; I f5.com>; 
Clegg EO th.com>; SRG fb.com>; Joel Kaplan ED fb.com>, 


o>; TO or; SO TD com 
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Ofb.com>; 


Dfb.com>; =a 


@fb.com>: 


MOfb.com>; Mmib.com>; 
Ofb.com>- 
Qfb.com>; @fb.com>; 
mtb Com > mtb com>: 
KOfb.com>; 
fb.com>: 
fb.com>; 


Mfb.com> 


fb.com>; 
Ofb.com>: 


Dfb.com>: 
ib com>; 
Mfb.com>; 
ubject: Re: [To Review: Disinfo Dozen stats and newsroom post 


mib.com> 


Thanks, a Who is on point to help us get this sorted? 


Nick would like to have something finalized ASAP that we can at least share privately with policymakers as we 
identify the right opportunity to post it publicly. 


Thanks everyone for helping us think through this and get something together. 


Fror: i © 1.com> 


Date: Tuesday, July 27, 2021 at 6:20 PM 
a fb.com>, Nick Cle 
@fb.com>, Joel Kap) con 


@fb.com>, eg >, 


dfb.com>, 


, fb.com> 
@ib.com>, fb.com>, 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


Methodology question: was what source of the shares data on the 483 posts with URLs? Was it shares on the 
post or coming from public URL shares data sat? 


| think it's really important that they are starting from a knownmisinformation data set: accordingly, | think our reply 
must speak to their role in known misinformation. 


How quickly can we do 4a and 4b? Seems should not be that hard? Hoping 4a is true and this is much easier. 


| would approach using the following: 

1. Explain the methodology taken by this report. 

2. Refute the methodology as being a bad approach, being nor-representative, circular {the groups focus on 
the dozen, and the dozen focuses on these groups) and undermining the complexity of the misinformation 
ecosystem and challenges we face (I like this b/c It's being a bit vulnerable and open, hopefully helping with 
credibility). 

3. Acknowledge {if true} the report did find the dozen was responsible for these 30 groups, but reference back 
to limitations as defined in (2) and that this is being misappropriated to a generalized understanding of online 
misinformation. 

4, Explain the role these 12 actors are playing in misinformation on FB. This would be my suggestion: 
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a. Check if the URLs from these 12 actors are marked as misinformation by 3PFC, matching, or other 
internal flags. If not, we need to go back fo drawing board a bit b/c there is no good way to then 
refute the statement with our own daia about misinformation, if we actually don't delieve it’s 


misinformation. 
b. Assuming yes, look at the proportion of known misinformation coming from the dozen for both: 


i. URL shares 
ii VPVs 
c. Potentially share one or both of above. 
5. If possible speak to prevalence of vaccine misinformation on FB, less relevant to the story at hand, but helps 


us with the next story. 


Fron: 1 .com> 


Date: Tuesday, July 27, 2G21 at 2:34 PM 
eee 
Mi epg ict __ieg Nick Clegg 


fb.com>, Joel Kaplan 


iS eg 


-—— oe 
EEE (9. com>, 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


Hi all, 
e Links Understand: nd team will conduct an understand 
over the next ks on the opportunity with links. This will help inform our enforcement policy 
around links. will help coordinate with Policy. 


¢ Source of 65% assertion (73% on FB): From 9g "This analysis was done on 483 pieces of 
content (posts with URLs} from 30 pre-identified anti-vax FB groups between 2/1 and 3/16. 
There is no explanation of how these groups were chosen. There is no evidence to suggest that 
their sample is generalizable, and that the content shared in these 30 groups is representative 
of the content ecosystem we have in FB. They coded the content based on whether it is from 
disinfo dozen or not, and looked at # of times disinfo dozen content was posted / reshared, 
relative to the rest of their sample. This is how they came up with the 73% number. 
It's important to keep in mind that the numbers they are using for prevalence do not represent 
reach or VPVs on platform. They looked at # posts and shares of the URLs in their initial 


sample." Analysis - https:/Avwww.counterhate.com/disinformationdozen 


¢ Explaining the state of the ecosystem: We are teeing up some options around sharing 


Misinformation prevalence and other measures that could indicate the health of our ecosystem. 
re 4 is taking the lead on the quip. We expect to have some recommendations on 


how to proceed by the end of the week. 
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Sent: Monday, July 26, 2024 4:52 PM 


@tb.com>; 
fb.com>; Joel Kaplan 

fb.com>; 
fb.com>; 


com>: 
Dfib.com> 


Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


Comments: 

¢ Suggested timing may be tight given we are still brainstorming and this is a bit of custom ask. 

« | would love to start from, independent of the comms narrative, a basic descriptive analysis on what is 
happening here —1 have not seen this, so it’s a bit hard to have a perspective on the specific approach to 
talking points. (RE s this something done / planned? 

« The 65% biden stat — do we know where this comes from, what the method is, etc? It’s possible for 
example, with how they are choosing io define this metric, the 65% stat is true, but we'd disagree on the 
method / definition. Or it may be true that we agree on the theoretical method / definition, but we think they’d 
miscalculated. 
| think there there is an important question here — are we: 

9 (1) trying to refute the claim directly 

9 {2) explain to the best we can what is happening on our platform 

9 Right now | think the proposal attempts do (1) but doesn’t really back it up. It more effectively does 
(2), but feels too limited. | think we can attempt to do both here, but right now | sort of think we are 
doing a half-job on both. 

The biden quote most closely reads as prevalence — although unknow or what, likely not VPVs. While it may 

make sense to communicate in terms of vaccine vpvs and removals, we should validate through any more 

direct prevalence proxies that the story Is consistent with vovs and removals, and may need to explore 
things Ike link shares that are violating. 

e “What is misinformation?” is a debate — we see a variety of definitions externally and internally have barriers 
tiers such as BTV and a few categories of misinformation. What exactly is Biden talking about and what are 
we talking about? Would be a bad outcome if Biden is really talking about B2V and we talk about removable 
misinfo, and then our enforcement doesn't match the complaint. 

e | think the % of vaccine related content cn the platform is mostly irrelevant here. Especially when prevalence 
small, it's possible a high portion of misinfo comes from small % of VPV. We should be focused on 
removals, prevalence , and other measures that speak to violations. Otherwise Just leaves ambiguity. 
Possibly helps with the narrative but not in disputing the claim. 

¢ The authoritative information and vaccine hesitancy lines are useful from an overall narrative perspective, 
but I'd include in the unrelated to the story category, and to do the degree we are trying to fight the 
“unrelenting staying power of the misleading stat that 12 people are responsible for 65% of COVID/vaccine 
misinformation”, then directly focus there. 


Date: Nionday, July 26, at 4:41 PM 


Mib.com>, 


@fb com>, Nick Clegg 
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De: 
Subject: Re: To Review: Disinfo Dozen stats and newsroom post 


First, kudos to the team who worked on this. Great tone and substance. 


| don't want vestions from below to getlost, so I've repasted his and am adding one of my own: 


FROM 

1/ Tactically, a lot of the criticism is about their URLs/websites. So | worry that our stats (e.g., "views on posts 
from Facebook and Instagram accounts associated with these 12 people") may not sufficiently address the 
question we're getting, unless we include posts with their URLs too. 


2/ On the "implicit" description of our Top 100 - | worry about the precedent/sustainability of doing so. If we want 
to include that section, | would suggest fo make it more abstract - we can say the most viewed content comes from 
such and such authoritative sources, with broad words like "mostly", "the top", etc without putting specific numbers. 
The moment we put numbers in there, we neec to define what they represent, it then becomes very 
concrete/specific and then we'll look silly for not sharing more fully / end up sharing. §§ One suggestion would be 


to change it to say “the majority comes from reliable sources including... .” — BR woud that work for you? 


FROM ME: 

3/ When we say a lot of the content from the 12 people doesn't violate, | worry people might say, “Well, maybe you 
should change your rules then!” It might be more persuasive to point out that “much of the content they have 
posted is unrelated to vaccines or Covid-19.” Privacy/Legal, would that be ok? 


From: fb.com> 
Date: Monday, July 26, 2021 at 4:30 PM 


ubject: Re: To Review: Disinfo Dozen stats and newsroom post 

While | defer to the comms experts on the wisdom and way to push back, a few thoughts from my side: 

1/ Tactically, a lot of the criticism is about their URLsAwvebsites. So | worry that our stats (e.g., "views on posts 
from Facebook and Instagram accounts associated with these 12 people") may not sufficiently address the 
question we're getting. unless we include posts with their URLs too. 


2/ On the "implicit" description of our Top 100 - | worry about the precedent/sustainability of doing so. If we want 
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to include that section, | would suggest to make it more abstract - we can say the most viewed content comes from 
such and such authoritative sources, with broad words like "mostly", "the top", etc without putting specific numbers. 
The moment we put numbers in there, we neec to define what they represent, it then becomes very 
concrete/specific and then we'll look silly for not sharing more fully / end up sharing. 


From: fb.com> 


Sent: Monday, July 26, 2024 11:34 AM 


To: Nick — < fb.com>; EG fb.com>; Joel Kaplan 


ifb.com>; 


Dfb.com>; 


fb.com> 
Subject: To Review: Disinfo Dozen stats and 1ewsroom post 


Hi all - 


Given the unrelenting staying power of the misleading stat that 12 people are responsible for 65% of 
COVID/vaccine misinformation - both m comnents last week from President Biden on Monday to reporters and 
in Wednesday night's CNN Town Hall. as well as widespread coverage trom reporters - we have drafted a 
newsroom post that pushes back with our own data and examples to rebut the external claims. The goal ts to 
provide a single source of truth on the actions we /ane taken on these accounts as well as contextualize what 
people are actually seeing on our platform. 


Before running these statistics through the approval process, we want to get feedback from the “To” line on 
whether or not you agree with the direction and sentiment of the post. We don’t have a definitive date yet to 
publish, 1t will depend on how quickly we can run through approval processes, but ideally, we could have this 
ready this week to deploy during the next pubic press cycle on this topic. 


Full draft below. The text in red are new - not vet pulled or reviewed - data points we would like to include. 


Thanks, 
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https: docs.zoovle. com document d ]tCsOaSels INsT8D73 UY MLK-4Z-s SEVOekmwMfsdsOkeE edit 


Missing the Forest for the Trees: Most People See Authoritative Vaccine Information on Facebook, Not 
Posts From 12 People 


There has been a debate about whether the global problem of COVID-19 vaccine misinformation can be solved 
simply by removing 12 people from social media platforms. Supporters of this narrative claim that these 12 
people are responsible for 65% of online vaccine misinformation. This itself 1s misinformation — and distracts 
from the complex challenges we all face in addressing misinformation about COVID-19 vaccines. [[In fact, views 
on posts from Facebook and Instagram accounts associated with these 12 people represent just O.X°o of all 
vaccine-related posts on our platform. Only 0.NX°o of these views are on posts we ve removed for violating our 
rules on COVID-19 and vaccine misinformation. ]] 


We agree it’s important to remove accounts that repeatedly violate our rules. That’s why we have removed nearly 
[three dozen] Pages, groups or accounts associated with these [2 individuals, including at least one linked to each 
of the 12 people, for violating our policies or creating recidivist accounts. We have placed penalties on [XX] 
additional Pages, groups. or accounts, like moving their posts lower in News Feed so fewer people see them or 
not recommending them to others. The remaining accounts associated with these individuals are either not posting 
content that breaks our rules, have only posted a small amount of content that has been deleted as violating, or 
are Inactive. 


But focusing on these 12 individuals misses the forest for the trees of how we are tackling this challenge. We 
have removed [[hundreds of accounts, pages, and groups|] for repeatedly violating our rules against 
spreading COVID-19 and vaccine misinformation. We also regularly review the most-viewed vaccine content 
on Facebook. We think it’s important to look at how many people actually see certain content rather than who 
likes or shares a post because it’s more reflective of a person’s experience on Facebook. 


[[Over the past two months, about 54°o of the most viewed vaccine-related content on Facebook was from these 
reliable sources: LINICEF, Health and Human Services, the Centers for Disease Control and Prevention, National 
[nstitutes of Health, The White House, President Joe Biden, Vice President Kamala Harris, The New York Times, 
The Washington Post, CNN. NPR, and ABC News. Three percent was content that did not violate our policies 
but discouraged vaccination so we moved it lower in News Feed so fewer people see it, and only 0.3° « of posts 
were removed for violating our policies. The rest was from focal and other news sources or other benign content 
about vaccines. None of the most-viewed vaccine content was from any of the accounts associated with these ]2 
individuals. ]] 


Since the pandemic began, we've shown more than 2 billion people reliable health information, encouraged 
credible health experts to post on our apps, and put in place strong policies against harmful COVID-19 and 
vaccine misinformation. And we removed more than 18 million pieces of content that violate these policies. 


But, real-world outcomes are what matter the most. According to data from Carnegie Mellon University and the 
University of Maryland, surveying more than 70 million people, vaccine hesitancy among people in the US on 
Facebook has declined by 50% since January and 85% of Facebook users in the US now say they either 
have already been vaccinated against COVID-19 or plan to be soon. 
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None of this is to suggest that our work is done or that we are satisfied. Tracking and combating vaccine 
misinformation ts a complex challenge, made worse by the fact that there is no common definition of exactly 
what it is. That's why we work closely with external experts and governments to make sure that we are 
approaching these issues in the right way and make adjustments if necessary. In the meantime, we will continue 
doing our part to show people reliable information about COVID-19 vaccines from health experts and help 
people get vaccinated. 


+t+4+ 
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Exhibit 71 


Internal Facebook text thread 


605 


From: 0 = THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 


eons s z ——_— 
To: 


Sent: 8/3/2021 10:07:07 AM 
Subject: Message summary [{"otherUserFbld":100024204053753,"threadFbid”: null}] 
Attachments: 232144141_1183054688825430_9202582289777875067_n.png 


(8/03/2021 08:45:36 PDT): 
>Hey mind giving me access to this doc? https://docs.google.com/document/d/1x- 


-Done 


WN 2/02/2021 09:47:12 evr): 


>You're trying to get input by eod on this? 


GS-3 03/2021 08:47:23 ppt): 


>is there someone that's helping you coordinate from the product side? 


>Mid-day if possible (1 pm PT). 


>Sorry this is a mad dash. 


we've all been there 


>Initially we were sd to get this out Friday and there was no time to vet with 
anyone, then SR told us we could take one more day to get Product input 


GNM (3/03/2021 09:47:54 ppt): 


>i'm happy to help 


28 02/2021 08:48:10 PDT): 
>so we figured we'd at least flag, but I will be sure we are caveating extensively that 


these ideas aren't fully vetted 


A 

f 
x 
an 
o 
t 
a] 
& 
| 


Jo you own this doc? 


ifs 


>Also is there a set up / intro to the problem you could share? 


(Qo; 2/9? nc 
(8/03/2021 093 


2:00:07 PDT): 
is where we're falling short and why 


~ 
a 
js 


v 
7 
! 


‘2 
\o 


8/03/2021 09:00:23 PDT): 
pone concerning piece of news is health frx for US is up significantly 


oO 
o 


/03/2021 09:00:38 PDT): 
>https://fh.workplace.com/groups/229636808076353/permalink/566130171093680/ 


(8/03/2021 09:00:44 PDT): 
been able to understand why yet 


e 


ut ve |} 


20 PDT): 


co 

v 
F 
= 
c 
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>does it make sense for us to spend 30m running through examples of this type of viral 
content and see what levers we may need to be more aggressive with? (if i'm going overboard 
and we just need responses to the time it takes to implement these Ilmk) 


8/02/2021 09:46:49 PDT): 

>I hope we can learn more about that FRX trend. Concerning... For today, the problem 
statement is honestly one of perception/tough relationship with WH, which specifically 
wants us to demonstrate additional steps on four issues they've raised, including doing 
more to address the disinfo dozen actors who are routinely cited in the press. So our 
solutions are mostly tailored around addressing that, rather than the other problems we've 
been trying to get at longer term. I would love to understand the viral content we're 
seeing break through our enforcement, but I don't think it's crucial to turn that around 
today given the tight deadline. 


© 8/93/2021 09:58:02 PDT): 
>ok i set up a pm jam on the topic of US health frx - would be great to have you there 
tomorrow but i marked you as optional be you might be busy with this meeting 


(8/03/2021 10:00:42 PDT): 
>in the doc, there seems to be a problem with a comment that's copied over on the eta which 
ismaking it hard to track the status of the product effort 


EE (8/03/2021 10:00:44 PDT): 


shared: 232144141 1183054688825430 9202582289777875067_n.png 


2/03/2021 10:06:51 PDT); 


>I'm going through comments now... let me see if I can sort out what you mean 


(8/03/2021 10:07:07 PDT): 
>thanks i think that will help us see where there are gaps 
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Exhibit 72 


Internal Facebook email 
correspondence 


608 


From: (= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=1E14C8 EF2D41566244181> 

To: Nick Clegg; a 

Sent: 8/11/2021 6:34:03 AM 

Subject: Re: Pre-read Re: MTG: Covid/WH update 


You re right that a version of 2iv below was presented in the pre-read and we decided not to move forward (Bad 
not had a chance to dive into it and you also expressed concerns), When Hiiiiient back and discussed with 

they agreed with a narrower version, 

The version of 2iv that was presented in the pre-read was to “Develop a strike system for health-related Partly False and Missing 
Context ratings that could trigger domain/Pase'Croup account Repeat Offender {RO} status in more instanees.” The version laid 
out below only focuses on domains 


I don't think BB re-cscalated given their support. but Iet us know if vou d like us to re-open, 


From: Nick Cleqg @fb.com> 
Date: Wednesday, August 11, 2021 at 3:22 AM 


To: {o.com >, iT fb .com> 


Subject: FW: Pre-read Re: MTG: Covid/WH update 


| thought we'd decided not to do 2iv, or am | getting that mixed up with another measure (the one both [end 
| expressed concerns about)? N 


From: if com> 


Date: Tuesday, August 10, 2021 at 10:08 PM 


To: Nick Cleq¢ \fb.com>, fb.com>, fb.com>, 
>fb.com>, fb.com>, 


Subject: Re: Pre-read Re: MTG: Covid/WH update 


Thank you for your time on Friday to discuss our response to the Surgeon General on our Covid 19 work. 
Following up to recap the plan of record and t:melines here: 


Timeline: We received a follow up note from the Surgeon General's office on Friday asking us to send an update 
of any new/additional steps we are taking on kealth misinformation in light of the new CDC advice within two 
weeks, As such, we're aiming to finalise our response by 8/20, incorporating the work below, We’ll schedule 
some time with this group to review progress early next week 


6, at the same time, we are still working to set up time as pronused with a: do a measurement 
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deep dive. We'll revert back with a recommendation jor who should staff this alougside ia 
Plan of record: 
1. Transparency: 


1. We will prepare a Covid-19 vaccine version of our Widely Viewed 
Content Report for public release as soon as possible (Owner: 


ii. We will internally validate and review with this group once ready US 
VPVs of tthat violates our Covid M&H policies as a % of US Covid-19 VPVs 
(Owner: ) 


i, We won't at this time prepare a BV prevalence number for public 
release 


‘i. We will do further work to scope a larger version of the Covid-19 
Widely Viewed Content dataset (e.g. N=10,000) shared via FORT with specific academics 
for independent research (Owner:  - 0.6. se fave shared the proposed plan 
With RBBB whe is supportive of dus and we re working with her team on both the dataset 
concerns and proposal for which academics we share this with. 


v. We will validate and publicly release the data around the 
Disinformation Dozen via a Newsroom post. We will not prepare an interim stat to use in 
case we are pressed for one before the NRP and validation is ready (Owner 


2. Enforcement: 
a. We will scope product work for the following changes and execute ones that are easy to do (Owner: 


1. Designate linked assets as non-recommendable 


Hw ©=©Count COVID M&H, Vaccine WDH, & COVID RFH toward misinfo 
Repeat Offender Status 


mi. Demote Partly False rated Covid or vaccine misinformation more 
strongly 


iv. Develop a strike system for health-related Partly False and Missing 
Context ratings that could trigger domain Repeat Offender (RO) status in more instances 


3. Other: 
a. We will revert back in the next day or so with recommendations around NEQ levers and other options 
for boosting authoritative information (Owner: 


Thank you 


From: fb. com> 
Date: Thursday, August 5, 2021 at 9:54 PM 


To: Nick Clegg fb.com>, fb.com>, 
b.com>, .com>, 
4H Cb om > EET C'9.com>, 


com> 
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Subject: Pre-read Re: MTG: Covid/WWH update 


Ahead of our meeting tomorrow, we're providing you with an update on our response to the four asks from the 


White House and dectsions from you on these options. Please see a link to the pre-read with the full details of 
options here. 


As a reminder, the four asks named in the Surgeon General's Advisory: 


1. Measure and publicly share the Impact of misinformation on their platform. Facebook should provide, 
publicly and transparently, data on the reach of COVID-19 — COVID vaccine misinformation. Not just 
engagement, but the reach of the misinformation and the audience that it’s reaching. 

2. Create a robust enforcement strategy that bridges their properties and provides transparency about the rules 

3. Take faster action against harmful posts 

4. Promote quality information sources in their feed algorithm. Facebook has repeatedly shown that they have 
the levers to promote quality information. We've seen them effectively do this in their algorithm over 
low-quality information and they’ve chosen not to use it in this case. And that's certainly an area that would 
have an impact 


The decisions we need to align per each ask are: 


1. Transparency [Ask #1} 
a. Should we release any of the following: 


i. ACovid-19 vaceme version of our Widely Viewed Content Report 
[recommendation]: 


ii, US VPYs of content that violates our Covid M&H policies as % of US 
COVID-19 VPVs [recommendation] 


il. USVPVs of content our classifiers have labelled as barriers to 
vaccination content as “o of US COVID-19 vaccine VP Vs (“BV"}? [not recommended] 


Iv. A larger version of Covid-19 Widely Viewed Content dataset (e.g. 
N=16,000) shared via FORT with specific academics for independent research 
[recommendation] 


vy. Tocounter the claim that there are 12 tndividuals who are responsible 
for the majority of the kealth misinformation on Facebook, do we release data either: 
1. Publicly (recommencation], or 
2. to the White House and US policy makers only? [not recommended] 
2. Enforcement [Ask #2] 
a. Do you agree that we should take the following four actions now: 


1. Designate linked assets as non-recommendable (option la below} 
i, Count COVID M&H, Vaccine WDH, & COVID RFH toward misinfo 
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Repeat Offender Status (option 2a below) 


il. Develop a strike system for health-related Partly False and Missing 
Context ratings that could trigger domain/Page/Group/account Repeat Offender (RO) 
status in more instances {option 2b below) 


1v. Demote Partly False rated Covid or vaccine misinformation more 
strongly {option 2¢ below) 
b. Are there other nor-recommended actions in the document that you think we should take now? 


Thank you 
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Exhibit 73 


Internal Facebook email 
correspondence 
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From: {O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=BRANDIHB3D8> 

To: 

cc: 

Sent: 8/18/2021 8:01:56 PM 

Subject: Re: Pre-read Re: MTG: Covid/WH update 


Huge team effort — thanks, alli 


From: fb.com> 
Date: Wednesday, August 18, 2021 at 5:14 PM 


To: fb.com>, fb. com> 

GO {5 .com>. fb.com> com>, 

HE fb.com>, fb.com>, fb.com>, 
fb.com> 

Cc: fb.com> 


Subject: Re: Pre-read Re: MTG: Covid/WH update 


+ {million to all of this. Such enormous thanks to all of you (and to you too m7) this was excellent. 
Get Outlook for iOS 


From: ES A com> 


Sent: Wednesday, August 18, 2021 8:05:13 PM 


Cc: eee (>.con>, EO (>.com> 


Subject: Re: Pre-read Re: MTG: Covid/WEH update 


The credit really goes to 
GE such a lot of high quality work went into this to get to an end result that we felt confident sharing. Thanks 


team! 
Also, beyond “correcting the record” externally (which is really important!}, | am hopeful that this data also spurs 


follow-up work to address policy and enforcement gaps that were discovered (e.g. we currently don't look at 
content within url shares to make enforcement decisions). c 


Regards 


From: fb com> 
Date: Wednesday, August 18, 2021 at 1:35 PM 


To: fb.com> 
Ce: fo.com>, io’) com> 


Subject: Re: Pre-read Re: MTG: Covid/WH update 


‘a 


| wanted to drop you a note to say thank you vary much for your tireless efforts to get the ‘disinfo dozen 
newsroom post through stat review and out into the world. At every juncture, you were thoughtful and methodical 
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about wnat numbers would make the most sense to release — balancing our communications goals and timelines 
with the practical demands of validating the stats. | know we would not have gotten this done without your diligence, 


and — while | don't think we're totally done with this conversation (©), you allowed us to make our best case to the 
Biden admin and press, and it is greatly appreciated. 


Onward! 


From: fb.com> 
Date: Friday, August 13, 2021 at 6:21 PM 
To: Dfb.com>, Nick Clegg 4 
a@fb.com>, 


@fb.com>, Ne Ed 


Mfb.com>, 
Ofb.com>, i’ 
a fb.com>, i 
fb.com>, 


@fb.com>, 


@fb.com> 
fb.com>, 


Ofb.com> 


Ofb.com> Ofb.com>, 
@ib.com>, 
@fb.com>, 


M@fb.com>, 


@Tpb.com>, 
afb.com>, 


Dib.com> 
fb.com>, 


fb com>, 


fo.com> 
Subject: Re: Pre-read Re: MTG: Covid/WH update 


We have time with some of you on Monday am to review progress, and share our recommendation on the list of 
transparency-related commitments we should include, as part of our response to the Surgeon General’s office 
(response due on 8/20). 


Specifically, we are proposing we confirm with the WH/SG that we are working to release the following pieces of 
data in the fall: 

1. Covid-19 Vaccine version of Widely Viewed Content Report 

2. Larger Covid-19 Vaccine WVCR dataset via FORT 

3. Misinformation and Harm prevalence 
We expect the validation work for these to take 1-2 months, so optimistically the earliest we can release these is 
end of September, committing to “fall 2021” gives us additional buffer until November. We aren’t recommending 
we make a public commitment on sharing this data as part of CSER next week (as aligned with comms), but do 
make the commitment in our letter back to the Surgeon General on 8/20. Additionally, in the immediate term, we 
are planning to publish the data around Disinfo Dozen via a Newsroom post this week. <link to draft - pending stat 
review>. Finally, we recommend that we also work on preparing a “benign prevalence” metric {details below) for 
public release, but don't include it in the SG response, since it is a new workstream. 


Details: 
1. Covid-19 Vaccine version of Widely Viewed Content Report 
1. What we will say: The vast majority of high reach vaccine content on our platform is either from 
authoritative sources or benign. A small fraction is borderline vaccine hesitancy content. 
2. Definition: Top 20 posts in US ranked by reach (organic, not including ads) related to Covid-19 
vaccine topic during a 2 month period May-June 2021. 
3. Preview of report [pre-validation]: <link to dash>. Among the top 20 US vaccine posts in May-June, 
1-16 are authoritative or benign (7 are from UNICEF, 6 from WHO), rank 17-20 are borderline B2V. 
1. Risks: even though majority of content is authoritative, the report will not be all clean, and likely 
include some borderline vaccine hesitancy content, though we are fairly confident it won't 
include violating M&H content. [Examples of BV from the pre-validation draft list: rank 17, 18, 
19, 20] 
4. Limitations/caveats on methodology: 
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1. Time period: we are not able to go back in time to cover an entire quarter without significant 
effort (need to retrieve raw data from cold storage). 

2. Classifier precision/recall: We plan to manually review all the top posts for recall misses from 
the vaccine classifier. (~6000 posts to review, Vaccine topic Rank #20 post is overall Rank # 
5962} 

5. Timeline/ETA for release: Oct 1 via blog post. Releasing these in report form via transparency center 
will require significantly more effort and time (based on learnings from FB App team), we recommend 
releasing this via blog post. 

2. Larger Covid-19 Vaccine WVCR dataset via FORT 

1. What we will say: We are sharing a larger dataset of top vaccine related content on our platform ina 
privacy compliant manner with selected academic researchers, for independent research. 

2. Definition: Identical to 1 above, but with a larger value of N (tentatively N=10,000). We would follow 
the standard FORT playbook on privacy review and access control. 

3. Limitations/caveats on methodology: 

1. Same caveats as 1 apply here as well, additionally we cannot manually review the dataset for 
classifier recall misses. 

2. This dataset is not meant as a representative sample of all content on facebook, e.g. it does 
not include Friends-and-Family private sharing. If the researchers try to calculate prevalence 
using this dataset, it would be misleading. This concern is similar to what we currently face with 
the URL Shares dataset. However, we feel that calling it Top 10,000 makes this limitation 
clearer and helps prevent setting incorrect expectation of representativeness. 

4. Who can access: 

1. We recommend that the dataset first be provided to the 300+ researchers who have access to 
our URL shares dataset and then subsequently to researchers who sign the Researcher 
Platform Agreement. 

5. Timeline/ETA for release: Oct 22. Our optimistic estimate for releasing this dataset is 2-3 weeks after 
#1 above. (We will review with PXFN in parallel) 

3. Misinfo&Harm prevalence 

1. What we will say: [these are current pre-validation stats] Across US, 0.04-0.11% of Covid content 
violates our misinfo and harm policy, and Covid content contributes to only 3% of all views in US on 
the platform 

2. Definition: Denominator = content classified to be related to Covid-19, Numerator=subset of 
denominator that violates our misinfo and harm policy. 

3. Limitations/caveats on methodology: 

1. The policy only covers the worst-of-worst content that can lead to imminent harm, and does not 
cover borderline content that is not eligible for removal. 

2. The prevalence estimate has dependency on covid classifier accuracy. Further, our 
measurement of the accuracy of COVID classification has some gaps. 

3. Optionally we can also share global prevalence which is lower than in US (0.02%-0.05%). We 
recommend limiting to US. The global measurement covers 73% of MAP on FB by covering 
English, Arabic, Bengali, Hindi, Indonesian, Thai, Tagalog, Spanish, French, Italian. 

4. Timeline/ETA for release: Aug 31. 

4. Benign prevalence (New Work in Progress) 

1. What we are working on: 

1. 1 prevalence metric to describe % of US Covid19 Views and Reshares (including QPs} by 
credible sources: UNICEF/WHO, Government Orgs (CDC, Health Departments), 
National/Local Media 

2. Definition for another prevalence metric for “good” content on platform, which will be based on 
vaccine sentiment & source quality 

2. Definition: 

1. TBD 

3. Limitations/caveats on methodology: 

1. For denominators, same caveat with regards to the accuracy of Covid19 and Covid19 Vaccine 
classifiers as stated above. 

4. Timeline/ETA for release: 

1. Finalize definition for review: 2 weeks 

Looking forward to the discussion on Monday, and we will share notes/decisions with this broader group after. 
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From: Bo 1). com> 


Date: Tuesday, August 18, 2021 at 1:08 PM 
To: Nick Cle 


fb. com> fb.com>, 
>fb.com>, fb.com>, 


Eb .com>, 
Cc: 


TEE@)b.com>, 
Subject: Re: Pre 
ee 
Thank you for your time on Friday to discuss our response to the Surgeon General on our Covid 19 work. 
Following up to recap the plan of record and t:melines here: 


fb.com>, 


Timeline: We received a follow up note from the Surgeon General's office on Friday asking us to send an update 
of any new/additional steps we are taking on kealth misinformation in light of the new CDC advice within two 
weeks, As such, we're aiming to finalise our response by 8/20, incorporating the work below. We'll schedule 
some time with this group to review progress early next week 


A, at the seme time. we are still working to set up time as promised with a. do a measurement 


deep dive, We'll revert hack with « reconunendation for who shouted staff this alongside Guy, 
Plan of record: 
1. Transparency: 


1, We will prepare a Covid-19 vaccine version of our Widely Viewed Content Report 
for public release as soon as possible (Owner: 


i. We will internally validate and review with this group once ready US VPVs of 
mare " violates our Covid M&H policies as a % of US Covid-19 VPVs (Owner: 


ili, We won't at this time prepare a BV prevalence number for public release 


A: We will do further work to scope a larger version of the Covid-19 Widely Viewed 
Content dataset (e.g. N=10,000) shared via FORT with specific academics for independent 
research (Owner: i - 2.6. .0¢ fave shared the proposed plan with Frio 
is Supportive of this and we re working with her teant on both the dataset concerns and 
proposal for which academics we share this with, 


v. We will validate and publicly release the data around the Disinformation Dozen via 
a Newsroom post. We will not prepare an inter Incase we are pressed for one 
before the NRP and validation ts ready (Owner: 
2. Enforcement: 
617 


CONFIDENTIAL TREATMENT REQUESTED - META-118HJC-0061996 
NOT FOR DISTRIBUTION - MEMBERS & STAFF ONLY 


a_We will scope product work for the following changes and execute ones that are easy to do (Owner: 


1, Designate linked assets as non-recommendable 


ii, Count COVID M&H, Vaccine WDH, & COVID RFH toward misinfo Repeat 
Offender Status 


ii. Demote Partly False rated Covid or vaccine misinformation more strongly 


iy. Develop a strike system for health-related Partly False and Missing Context ratings 
that could trigeer domain Repeat Offender (RO) status in more instances 


3. Other: 
a. We will revert back in the next day or so with recommendations around NEQ levers and other options 
for boosting authoritative information (Owner: 


Thank you 


From: EO fo. com> 


Date: Thursday, August 5, 2021 at 9:54 PM 


2>.con>, Eb com>, 


a Et op com>, | : 
fb.com> fb.com>, fb. com> 
—- com>, fb.com>, a 


2fb.com>, 


fb.com> 


Subject: Pre-read Re: MTG: Covid/WH update 


a/e priv 


Ahead of our meeting tomorrow, we're providing you with an update on our response to the four asks from the 
White House and decisions from you on these options. Please see a link to the pre-read with the full details of 
options here. 


As a reminder, the four asks named in the Surgeon General's Advisory: 


1. Measure and publicly share the impact of misinformation on their platform. Facebook should provide, 
publicly and transparently, data on the reach of COVID-19 — COVID vaccine misinformation. Not just 
engagement, but the reach of the misinformation and the audience that it’s reaching. 

2. Create a robust enforcement strategy that bridges their properties and provides transparency about the rules 

3. Take faster action against harmful posts 

4, Promote quality information sources in their feed algorithm. Facebook has repeatedly shown that they have 
the levers to promote quality information. We've seen them effectively do this in their algorithm over 
low-quality information and they've chosen not to use it in this case. And that's certainly an area that would 
have an impact 


The decisions we need to align per each ask are: 
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1. Transparency [Ask #1] 
a. Should we release any of the following: 


1. A Covid-19 vaccine version of our Widely Viewed Content Report 
[recommendation]: 


i. US VPVs of content that violates our Covid M&H policies as % of US COVID-19 
VPVs [recommendation] 


it. US VPVs of content our classifiers have labelled as barriers to vaccination content 
as % of US COVID-19 vaccine VP Vs (* BV”)? [not recommended] 


iv. A larger version of Covid-19 Widely Viewed Content dataset (e.g. N=10.000) 
shared via FORT with specific academics for independent research [recommendation | 


v. To counter the claim that there are 12 individuals who are responsible for the 
majority of the health misinformation on Facebook, do we release data either: 
1. Publicly [recommendation], or 
2. to the White House and US policy makers only? [not recommended] 
2. Enforcement [Ask #2] 
a. Do you agree that we should take the following four actions now: 


1. Designate linked assets as non-recommendable (option la below) 


i. Count COVID M&H, Vaccine WDH, & COVID RFH toward misinfo Repeat 
Offender Status (option 2a below) 


ii. Develop a strike system for health-related Partly False and Missing Content ratings 
that could trigger domain/Page/Group/account Repeat Offender (RO) status in more 
instances (option 2b below) 


iv. Demote Partly False rated Covid or vaccine misinformation more strongly (option 
2¢ below) 
b. Are there other nor-recommended actions In the document that you think we should take now? 


Thank you 
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Exhibit 74 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy’s office 
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From: Waldo, Eric — <Eric.Waido@hhs.gov> 


To: =a 


cc: 
Sent: 8/18/2021 2:39:09 PM 
Subject: RE: Disinfo Dozen Post 


Thank you, aa Appreciate you sharing this. 


For: SEO 1b com> 
Sent: Wednesday, August 18, 2021 2:16 PM 


To: Waldo, Eric (HHS/OASH) <@ ths. gov>: [@ gmail.com> 


Cc: ES fb.com> 
Subject: Fwd: Disinfo Dozen Post 


Eric and Btagging this post for you and for Surgeon General Murthy. This details how we are approaching 
content from the disinfo dozen. Please let me know If you have any questions. 


https //about.fb.com/news/2021/08/aking-action-against-vaccine-misinformation-superspreaders/ 


How We’re Taking Action Against Vaccine 
Misinformation Superspreaders 


In recent weeks, there has been a debate about whether the global problem of COVID-19 vaccine misinformation 
can be solved simply by removing 12 people from social media platforms. People who have advanced this 
narrative contend that these 12 people are responsible for 73% of online vaccine misinformation on Facebook. 
There isn't any evidence to support this claim. Moreover, focusing on such a small group of people distracts from 
the complex challenges we all face in addressing misinformation about COVID-19 vaccines. 


That said, any amount of COVID-19 vaccine misinformation that violates our policies is too much 
by our standards — and we have removed over three dozen Pages, groups and Facebook or 
Instagram accounts linked to these 12 people, including at least one linked to each of the 12 people, 
for violating our policies. We have also imposed penalties on nearly two dozen additional Pages, 
groups or accounts linked to these [2 people. like moving their posts lower in News Feed so fewer 
people see them or not recommending them to others. We've applied penalties to some of their 
website domains as well so any posts including their website content are moved lower in News 
Feed. The remaining accounts associated with these individuals are not posting content that breaks 
our rules, have only posted a small amount of violating content, which we ve removed, or are 
sumply inactive. In fact, these 12 people are responsible for about just 0.05% of all views of vaccine- 
related content on Facebook. This includes all vaccine-related posts they ve shared. whether true or 
false, as well as URLs associated with these people. 


The report upon which the faulty narrative is based analyzed only a narrow set of 483 pieces of 
content over six weeks from only 30 groups, some of which are as small as 2,500 users. They are in 
no way representative of the hundreds of millions of posts that people have shared about 
COVID-19 vaccines in the past months on Facebook. Further, there ts no explanation for how 
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the organization behind the report identified the content they describe as “anti-vax” or how they 
chose the 30 groups they included 1n their analysis. There 1s no justification for their claim that their 
data constitute a “representative sample” of the content shared across our apps. 


Focusing on these 12 individuals musses the forest for the trees. We have worked closely with 
leading health organizations since January 2020 to identify and remove COVID-19 misinformation 
that could contribute to a risk of someone spreading or contracting the virus, Since the beginning 
of the pandemic across our entire platform, we have removed over 3,000 accounts, Pages and 
groups for repeatedly violating our rules against spreading COVID-19 and vaccine 
misinformation and removed more than 20 million pieces of content for breaking these rules. 


None of this is to suggest that our work is done or that we are satisfied. Tracking and combating 
vaccine misutformation is a complex challenge, made more difficult by the lack of conunon 
definitions about what constitutes misinformation, and the reality that guidance from scientific and 
health experts has evolved and will continue to evolve throughout the pandemic. That's why we're 
continuing to work with external experts and governments to make sure that we are approaching 
these issues in the right way and making adjustments if necessary. In the meantime, we will continue 
doing our part to show people reliable information about COVID-19 vaccines from health experts 
and help people get vaccinated. 


Get Cutlook for iOS 


From: iE © f>.com> 
Sent: Wednesday, August 18, 2021 1:17 PM 
To: Flaherty, Robert EOP/WHO 

Cc: 

Subject: Disinfo Dozen Post 


Hi Rob, 


Flagging this post for your on our findings regarding the Disinfo Dozen—let us know if you have any questions, as 
always. 


a inc. ss & Dae 
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Exhibit 75 


Internal Facebook text thread 


623 


From: 


(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN= 
To: 


Sent: 
Subject: 


7/15/2021 5:28:28 PM 
Message summary [{"otherUserFbld":null, "threadFbld":3964439060301954}) 


12:04:35: PDT): 
else on 
Dozen? 

interested 


PREs¢e have bandwi 
The White House 
in what the 


this info 


do you 
enforcement on the 
accounts and now leadership is 
at all possible. I know we 
2se are the most important 


or someone 


lisinfo 


latest 


p 


have some so in 


info: 


or disabled? 
feature blocks the 
nonrec? 

in misinfo RO? 


active 


ount 


any count? 
-ount 


scount 


on 


ac 


15 we can use: https://f 


021 12:05:16 
should just 


or 


>That didn't tag 


2230 PDT) 3 


-Hi all! Pending a TSS) input, my 


given leadership attention would be to escalate 
work this request in around 30mns-lhr given my 


the 


via 


current inve 


PDT}. s 


12:31 26 


PDT) : 


ocus 


going to fi up a case this. 


forward. 


on 


is our fastest way 


PDT) : 


T/1IS/2021 1234 
I'm prioritizing 
the latest 


se sense —- we also want 


PDT}: 
qot tt active 


for 


accounts 


info 


PDT) : 


to make sure the account 


{15/2021 12351452 


finished the 


PDT) ;: 


zase I was working on if 


12:59:16 
For the 


Thanks so much =a 


"7/15/2021 Update" column as 


PDT}: 
wider group, 
"Updated". 


I'm market the 
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made a 
status 


fb.quip.com/gbmuAdBYYKG7 —- 


we 


thannel 


you need help with 


</O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 


OE> 


dth N to quickly refresh the 


nov 
statement about these 
is, we'd like to do this 


order of descending priority 


now 


thank yo 


can use the existing Case, 


jirectly. I wi 
stigation 


Since he has the most context 


erence 


re saying are dow 


this 


request 


completed entities in the 


META-118HJC-0058759 


>marking* 


{7/15/2021 133380346 PDT): 


>Hey MBBJ- checking on progress and ETA? 


— -» “a 13:32:16 PDT): 
>Hi and I are tag-teaming and we have 13 so far. The latest progress is on the 


July 15 tab. 


M5 2021 12:52:01 evr): 


>Gh great, I didn't know if that data was copied over or new -looks new 


(7¥1TSf/2021 1S:Sss$2 PPT): 
>ETA likely <lhr, we copied aver the format from the 6/2 review but the right most column 
is tracking all completed entities. Please let us if you have any questions on the 


data fields! 


TiAS/ 202). Jay84s ts PDT}: 
>Just wanted to make sure you saw the ask also whether 
totally removed from FB/IG (when you finish which have 


ae a 
Dozen have been 


(7/1S/2021. 133245221 PDT): 
Thanks for the flag! Will confirm that after the updates here. 


O21 133:46300 PDT}: 


ld you be able to summarize the actors themselves? {Dr sherri 


>To help that proc 
tenpenny, etc. ?) 


(7AAS/ 2021 13346519 POT): 
-I_ think we agreed the actual number of possibly linked accounts was 39, right Geass 
because VINE isn't technically Disinfo Dozen 


(7fISPZNZ1T L3sdTsl6 POT): 
Joseph Mercola 
>RFK Jr 
Ty & Charlene Bollinger 
>Sherri Tenpenny 
>Rizza Islam 
>Rashid Buttar 
>Erin Elizabeth 
Sayer Ji 
>Kelly Brogan 
>Christiane Northrup 
>Ben Tapper 
-Kevin Jenkins 


Ss 7/15/2021 13:48:11 PpT): 


>Thank you! 


Do you recall if Millions Against Medical Mandates was 
t 


ssociated with any in particular? 


-'s called out in the report but it doesn't list a name 


>hmmm...let me jog my memory 


Gs 7/15/2021 14:08:19 Pp): 

>From what I can tell it looks like Rashid Buttar and Erin Elizabeth don't have any 
accounts remaining. Sherri Tenpenny also looks like her only account is down - I don't see 
an FB account for her but the CCDH report suggests there is one 


GS 7/15/2021 14:12:02 PDT): 


>They may be considering her FB page as an account. 


7/15/2021 14:12:54 pPpT): 
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>Erin Elizabeth should definitely not have a presence since that takedown was done by the 
CIB team 


(T¥1IS/2021 14:13202 PT): 
>The Quip is now updated with the latest data and the summary on which entities still have 
a presence. I determined the same as Will's assessment {Rashid Buttar and Erin Elizabeth 
have no active accounts) 


(T/ALS/Z02Z1. PANAS GLO POT); 
~MAMM doesn't appear directly affiliated with any of the 
Northrup, Bigtree, and RFK content. I did find this IG ac 
https://www.instagram. com/maurahealth/?hl=en 


67/15/2021 14:14:31 PDT): 


>What about Tenpenny? 


CS 92021 aides pp): 
>I think all of her official accounts are off - does she havea FB profile/Page we don't 
know about? 


>For those with a pre ze, I updated the entity IDs of the remaining accounts. Tenpenny 
has an FB Page $199) with no violations. 


7/5/2021 14:15:31 PDT): 


>Does that mean we're at 40 accounts now? 


>So the page was in the Quip already and it was not a newly added entity. 


rsonalities, though promotes 
sount for their founder: 


I §7/15/2021 14:16:10 PDT): 


>Oh Tenpenny on vaccines - is that legit? 


2:16:39 PDT): 
off since that's inactive 


14 sA6%59" PDT) : 
-yes, though stakeholders may not view it that way 


202 14:17:04 PDT): 

>I'm not sure if there's a consolidated list of the 39 entities to cross reference. The 
page is xchecked and the admin is not Tenpenny's account. The latest post on the page was 
from 20 


7/15/2021 14:20:26 Ppr): 


s profile have strikes? 


WE 7/15/2021 14:24:17 por): 


-Yes sorry looks like that was blank. Updated now! 


{7/15/2021 14:24:32 PDT): 
>The profile has 5 standard and 1 severe strike 


(FFIS/20281 L432 s4S POT) ; 
>a Profile needs 9 strikes to come wn? If there are any that are close should we review 
recent posts? 


(7/15/2021 14:27232 PDT): 
>Profiles typically need 13 standard strikes to be removed. We can asses recent posts for 
the active entities but it is unlikely to lead to removal without a deduplication 


e2zc 


WS 7/15/2021 14:30:35 Por): 


“For the recent content review, would 15 posts suffice for the orange entities? 
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{7¥IS/2ZOUZ1 14330355: PPT): 


>Yeah that seems good 


{7/15/2021 14:34:39 PDT): 
Demotion - does this mean misinfo RO status for the entity? 


mm 
Q 
las 
et 


>Misinfo 


{7/15/2021 14:39%35 PDT): 
>So that's a separate signal that may or may not be helpful. It doesn't mean RO status but 
instead it shows whether recent content has been demoted 


{7/15/2021 14:40:05 PDT): 
>Determined through our feed diagnostics tool 


7/15/2021 14:40:29 PDT): 


J 


{7/15/2021 14:40:43 PDT): 
>Misinfo Ops may be able to help further clarify what the definition of the demotions are 
but here is the example from RFK Jrs Page: https://fburl.com/feedtools/3eeov2n6 


CTALS/Z021. ISsiSs12 POM: 

>Hi all, jumping in for HE who's hopefully taking a break. We shared a recap of this 
latest data with Thank you so much for the sprint. We'd also like to send an update 
to leadership by email but before doing that wanted to be really really sure Ops and 
Product are confident in what _ we've found, as we may then want to share the numbers on 
background externally. is there any more validation you'd ideally want to do? Is 
there someone on Product we could get to eyeball this too? thought  -°.< 
be good. Here's the recap: 


(IPLSZ2021. LSe 1 Ss PDD) 
have identified 39 accounts that are owned by, of appear to be linked to, the Disinfo 
Dozen. Of those accounts: 


ry 


15 have been disabled 

->{2) 4 are experiencing feature blocks and 10 are in non-rec status 
>{3) A final group of accounts has not posted sufficient violating content on our platform 
o be disabled or incur penalties, stopped posting content that violates our policies, 
don’t post about COVID or vaccines anymore, or in some cases are inactive. (e.g., RFK 

Miia. die” 


{7/15/2021 15:16 59.PDT) ; 
>I can help you find a product POC to verify. 


52021 572 PpT): 


>I assume it is to mostly verify the feature blocks/ non-rec status? 


CUALSFRO2Z1 15:217%52 PDT): 


on what you think would most benefit from Product eyes 


{7FFLSPZOZA LS Less POT):s 
>Having product validation for this would be great since I know there are some 
block/non-rec mechanisms that may not always show up in our tooling. 


sent content review for the 
ssment of the accounts unless 
of the review that would build 


>The only thing I would add is I have yet to complete the re 
orange accounts. I don't believe this should change the a 
granted an SOP to disable but this would be the last piece 


more confidence. 


(7/15/2021 15:19:42 PDT): 
>Yep, GS and I discussed and think it's OK if we don't have that completely up to date 
analysis, as that would only allow us to remove more content/accounts. But if it takes some 
time to get Product validation, maybe our timelines will converge... 


5/2021 15:20:33 Por): 


>If we find someone on misinfo product, it’d also be compelling to say which are in misinfo 
RO I think 


7/15/2021 15:26:28 PDT): 
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Doc if we align on on the name 
the details 


Dr" being a health keyword. I tagged you in the Quip with 
{7/15/2021 15:53:16 PDT): 
>Hmm, let me see. Last time I remember there were only 4 so trying to see what #5 was 


{2021 15:54213 PDT): 


322574634 is the newest? 


{7/15 


>Looks like 1789 


{7/15/2021 15:56:13 PDT); 
>The newest would be 17889927494100230. 


>It gets a bit more confusing since the active strike counts have to include IG USER CO 
strikes on Xchecked accounts like Tapper's IG. 


M12 2021 15:56:55 Por): 
>17889927494100230 is the one we aligned last time was violating in the June 2-3 review, 
which msde strike #4 according to the tab 


7/15/2021 : 
122574634 isn't Lieted: on June 2-3 - was that just an oversight or was this 


7152021 15:59:30 Por): 
>That was likely an oversight. ‘It looks li 
strike type which should still be counted 


7/15/2021 16:39:03 pp); 
>Update here that I identified one recent violating post on Kevin Jenkins' FB Profile. When 
removed, his strike count will increase to 7. 


634 was listed under an old 
correctly 


7/15/2021 16:45:05 PDT): 
>Is there any issue with proceeding to remove violating content? 


{7/15/2021 16:46:01 PDT): 
>I'll take a look - I think the 5th Tapper strike is probably a FP btw 


Ms 2021 1Les5e:1? PDT): 
>Confirmed this post from Jenkins is violating (well actually the root post is violating, 
if that matters for strike purposes) 300823306277647¢€ 


9 


6: 
>Claims that COVID does not exit 


8:47 PDT): 
>This post from Ben denne IG is non-violating and we should restore please: 


28822574634 


>For claims that COVID is a hoax, the claim has to be explicit that not exist, 


so the use of the #covidhoax hashtag isn't by itself violating. See 


context here to determine if it’s explicitly calling out that COVID does not exist. 
ple: 


Covid is a lie 

>Allow: New York Nurse Confirms COVID Criminal Hoax. VID criminal hoe 
can refer to any hoax around how the COVID situation is being handled, 
ssarily mean that ‘COVID is a hoax’ 


in this context 
by a hospital, 


and does not nex 


(7/15/2021 17:01:17 PDT): 
>On it thank you Haag I will remove Jenkins post and restore Tappers 


15/2021 17:20:36 por): 

onfirming here Jenkins post is deleted and Tappers' post is restored. I left two 
dJentified violations in the Quip for Sayer Ji's Account (1045208821) for policy 
confirmation. PREse will await confirmation prior to deleting. 


“In tandem, Misinfo Ops is working to confirm RO status of the entities in the quip. The 
subcase is C#989332. 
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GS «7 15/2021 17:28:28 por): 
>Hi all! Adding Mf No current PREsc AIs as all orange accounts have underwent recent 


content review. 
It looks like 


>I also wanted to flag a great callout by 
Tenpenny may be actively operating these two separate accounts that don't seem to be on the 
(IGU 17841436759576263 and FBU 1065255952 ) 


from a separate case. 


initial Disinfo Dozen-associated account list. 
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Exhibit 76 


Internal Facebook email 
correspondence 


630 


To: 


@fb.com] 
From: 


Joel Kaplan 


Subject: Re: [EXTERNAL] FW: Tucker Carlson anti-vax message. 


Open question whether it’s helpful or harmful for me to have to read them too. I find this kind of harassment from White 
House staff to be terribly galling, but useful to understand their perspective on us clearly .. . 


Get Outlook for i0S 


From: @fb.com> 

Sent: Thursday, April 15, 2021 10:23 AM 

To: Joel Kaplan; Kevin Martin 

Subject: FW: [EXTERNAL] FW: Tucker Carlson anti-vax message. 


Sharing with you (and not more broadly for now). | think it’s an open question as to whether it’s helpful or harmful for our SME’s 


(and | particular) to have to read Rob’s colorful way of describing things. But this is what | got back last night from him in 
response to our message re: the Tucker video. 


From: Flaherty, Rob EOP/WHO EE © w0.cop.gov> » 


Date: Wednesday, April 14, 2021 at 11:36 PM 
To G ©1b.com> 


Cc: Slavitt, Andrew M. EOP/WHO SEE © wh10.cop.gov ‘@) 
Subject: Re: [EXTERNAL] FW: Tucker Carlson anti-vax message. AY 
And sorry — if this was not one of the most popular posts about es ine on Facebook today, then what good is crowdtangle? 


fz) said that video was the most popular yester segon your data, which reflected what CT was showing. Tuckers 
video was top on CT today. What is different about this video, 


Sent from my iPhone SY 


On Apr 14, 2021, at 11:29 P erty, Rob EOP/WHO | @ who.eop.gov> wrote: 


| guess this is a good examp/@&of your rules in practice then — and a chance to dive in on questions as they’re 
applied. 


How was this not violative? The second half of the segment is raising conspiracy theories about the government 
hiding that all vaccines aren’t effective. It’s not about just J&J. What exactly is the rule for removal vs demoting? 


Moreover: you say reduced and demoted. What does that mean? There’s 40,000 shares on the video. Who is seeing it 
now? How many? How effective is that? 


And we’ve gone a million rounds on this in other contexts so pardon what may seem like deja vu — but on what basis 
is “visit the covid-19 information center for vaccine resources” the best thing to tag to a video that says the vaccine 
doesn’t work? 

Not for nothing but last time we did this dance, it ended in an insurrection. 


Sent from my iPhone 
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aa aOR apie 11 PM, Brian Rice <brianrice@fb.com> wrote: 


Making sure you receive-- 


From: Nick Clegg EE @fb.com> 

Date: Wednesday, April 14, 2021 at 10:51 PM 

To: Slavitt, Andrew M. EOP/WHO a @ who.cop.gov> 
Cc: TT © fb.com> 

Subject: Re: Tucker Carlson anti-vax message. 


Hi Andy - have looked into this some more. 


| realize it may be of limited comfort at this moment, but this was not the most popular post about 
vaccines on Facebook today. Our data is slightly lagging, and we’ll get back to you with more detail on 
this specific post tomorrow. Right now, it appears that it probably was among the top 100 most-viewed 
vaccine posts. I’m including a few examples of posts that were more popular today at the end of this 
note. 


Regardless of popularity, the Tucker Carlson video does not qualify for removal under our policies. 
Following the government’s decision yesterday, we are allowing claims that thé Johnson and Johnson 
vaccine causes blood clots, but we still do not allow categorical claims that # ther vaccines are 
unsafe or ineffective. » 


That said, the video is being labeled with a pointer to authoritative CO information, it’s not being 
recommended to people, and it is being demoted. 


The team is working on the follow ups from the meeting this Morning, including more details on most 
viewed/ranked content on Facebook and fi will begmetouch shortly on that - I'm v keen that we 
follow up as we'd agreed, and | can assure you th ere are on it. 


to get your guidance about what affirmati ges we should amplify right now. Consistent with the 
message we heard at the press cnr re currently emphasizing the safety and efficacy of the 


Moderna and Pfizer vaccines in the 


Popular Vaccine-Related con) ebook Today: 
E () 


Given the timeline that was provided today u decision about the J&J vaccine, it would be great 
es 


rmation Center. 


n1263927< 

NY Times: >https://www.nytimes.com/2021/04/13/us/politics/johnson-johnson-vaccine-blood-clots-fda- 
cdce.html< 

CDC: >https://www.facebook.com/10159031890151026< 

CBS: >https://www.facebook.com/10159467409732010< 


Heather Cox Richardson: >https://www.facebook.com/297363371758902< 


All v best 


Nick 


On 4/14/21, 10:52 AM, "Nick Clegg" <M @fb.com> wrote: 


Ok - sorry to hear about call today, will dig in now. N 
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Number one on Facebook. Sigh. 
Big reveal call with FB and WH today. No progress since we spoke. Sigh. 


Sent from my iPhone 


KO 


sS 
on 
g 
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Exhibit 77 


Internal Facebook email 
correspondence 


634 


From: GN <= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: 
Sent: 8/20/2021 5:10:12 AM 
Subject: Fwd: [A/C PRIV] Enforcement Update re COVID-19 


Do we account for all of these in the note to the SG? 


Get Outlook for iOS 


Sent: Thursday, August 19, 2021 7:24:53 PM 
To: Nick Clegg < 


Subject: [A/C PRIV] Enforcement Update re COVID-19 


Nick I i 


This email provides a follow-up to our August 6th discussion regarding our response ote 


geon General on 


COVID-19 misinformation. During that discussion, we agreed to further explore fou ae policy options for 
s have scoped the 


pll-out the first three options 


Please let us know if you have any concerns with the follow fbn 9 am ET tomorrow; otherwise, we 
plan to provide an update to the Surgeon General and start executing inst these tomorrow. 


Thank you, eo) 
Michael 


1. Option 1: Designate any assets linked to Grou ages/Profiles/Accounts, which have been removed 
for COVID misinfo violations, as non-r dable to users. 
a. Impact: Any asset linked to Grqups/Rages/Profiles/Accounts that have been removed for COVID 
misinfo violations would no ended to users (e.g., RFK Jr.'s |G Account is removed, so his 


FB Page will be non-reco 
b. Status: By the hat vee ive 


dable) 
So , we will enforce on approximately 60 linked assets related to the 


Disinfo Dozen hg en removed for COVID misinfo violations. Over the next three weeks, 
we will engage vet to understand how to mitigate the risk of over-enforcement here. We 
will then rotund fa recommendation on a broader policy change that will affect more than just 
the 60 Dis| r-linked assets. 


2. Option 2: Count ID Misinformation & Harm (M&H), Vaccine Widely Debunked Hoaxes (WDH), & 
COVID Repeatedly Fact-Checked Hoaxes (RFH) toward Misinformation Repeat Offender status. 

a. Impact: Currently, only 3PFC-rated False/Altered content counts toward misinfo repeat offender 
status, which results in demotions and demonetization for entities. Counting COVID M&H, Vaccine 
WDH, and COVID RFH strikes towards misinfo repeat offender status would more quickly penalize 
entities spreading COVID or vaccine misinfo on top of our normal Community Standards penalties. 

b. Status: We are targeting the end of September for launch. This includes updating language on 
existing transparency surfaces to notify affected entities how content we remove for COVID/Vaccine 
violations factors into their Repeat Offender status. 
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Exhibit 78 


Email correspondence between 
Facebook and Surgeon General 
Murthy’s office 


637 


From: Waldo, Eric (HHS/OASH) <a nhs. gov> 


To: Nick Clegg; Murthy, Vivek (HHS/OASH) 
cc: 

Sent: 8/23/2021 7:43:44 AM 

Subject: RE: Facebook Covid actions 

Hi Nick, 


| hope this finds you well. Thank you so much for following up with this detailed note. We are grateful for you and 
your team's attention to the concerns we have been raising and the work to address those ongoing concerns. 


Band | are also in touch, but we look forward to continuing to move forward together with urgency and 
solutions during these extraordinary times. 


Best, 
Eric 


From: Nick Clegg <{@fb.com> 
Sent: Friday, August 20, 2021 3:08 PM 


To: Murthy, Vivek (HHS/OASH) hhs.gov> 


Ce: Waldo, Eric (HHS/OASH) hhs.gov>; G2 omail com: 6 1>.com> 


Subject: Facebook Covid actions 


Dear Surgeon General 


Mans thanks again for the recent opportunity to discuss our Covid related work. You asked for an update on existing and new steps 
that Facebook is taking. As vou know. Facebook takes its responsibility during this prolonged. unprecedented public health crisis 
extremely seriousls. In light of our conversation we have been reviewing our efforts to combat COVID-[¥. and are eager to 
continue working towards our shared goal of helping more people get vaccinated and limiting the spread of harmful 
misinformation. 


The White House described four recommendations to social media platforms tn July. which cover access to authoritative 
information. enforcement and speed of enforcement. and transparency. Those are priorities we have shared throughout the 
COVID-IY pandemic. In this update. we describe both our historic actions in these areas. as well as new infornation on boosting 
access to authoritative information. and further policy work to enable stronger action against persistent distributors of vaccine 
misinformation. Finally. as agreed at our last meeting. we remain eager to meet with vou and/or vour team about our ideas 
regarding data that could potentially be shared with the public. 


Elevating access to better information 
We continue to review. experiment and adapt to find better ways to increase access to quality information. as we have done since the 
start of the pandemic: 

e We have heard your and others’ concern that people should be better able to access authoritative information 
on our platform. We agree, and have already taken action to make it easier for people to find more 
authoritative and trusted information in News Feed. We would be happy to describe these efforts to you in a 
specific briefing. 

e We continue to help people directly access accurate information through the COVID Information Center, and 
will keep adding to this as the situation evolves and especially as guidance for various populations is updated - 
including when children should get vaccinated, and when the already vaccinated should be getting boosters. 
So far we have connected over 2 billion people globally with resources about COVID, and in the US alone 
we've helped over 4 million people get vaccinated through our Vaccine Finder, which connects them with 
appointment information, directions, and contact information. 

e We're continuing to refine how we help health partners reach communities with less access to information or 
lower vaccination rates, leveraging the CDC’s Social Vulnerability Index and other resources to reach those 
populations with high-quality, authoritative information. 
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Limiting Potentially Harmful Information 
We continue to improve and refine measures that reduce the spread of potentially harmful content and limit the distribution of 
actors who share misleading information about COVID and the vaccine: 

e We will shortly be expanding our COVID policies to further reduce the spread of potentially harmful content on 
our platform. These changes will apply across Facebook and Instagram. 

o We are increasing the strength of our demotions for COVID and vaccine-related content that third party 
fact checkers rate as “Partly False” or “Missing Context.” That content will now be demoted at the same 
strength that we demote any content on our platform rated “False.” 

o We are making it easier to have Pages/Groups/Accounts demoted for sharing COVID and vaccine- 
related misinformation by also counting content removals under our COVID and vaccine-related 
Community Standards violations towards their demotion threshold. 

o Any entity linked to another entity that is removed for violating our COVID or vaccine misinformation 
policies will be rendered “non-recommendable” on our platform. 

° Lastly, we will also be strengthening our existing demotion penalties for websites that are repeatedly 
fact-checked for COVID and vaccine misinformation content shared on our platform. Together, we intend 
for these policies to further limit the traction that misinformation can get on our platform. 

e To date, we've rerroved over 20 million pieces of content for COVID- and vaccine-related 
misinformation. We've also taken action against people who repeatedly post content that violates our policies. 
Since the beginning of the pandemic, we have removed over 3,000 accounts, Pages, and groups for 
repeatedly violating our rules against spreading COVID and vaccine misinformation. 

« We've specifically investigated the people sometimes identified in the media as the ‘Disinfo Dozen’. We've 
applied penalties to some of their website domains as well so any posts, including their website content, are 
moved lower in News Feed. The remaining accounts associated with these individuals are not posting content 
that breaks our rules, have only posted a small amount of violating content, which we’ve removed, or are 
simply inactive. In fact, these 12 people are responsible for about just 0.05% of all views of vaccine-related 
content on Facebook. This includes all vaccine-related posts they’ve shared, whether true or false, as well as 
URLs associated with these people. In total we have removed three dozen Pages, groups and Facebook or 
Instagram accounts linked to these 12 people, including at least one linked to each of the 12 people, for 
violating our policies. 

e We continue to notify people when content that they have interacted with is removed for violating our policies 
on COVID and vaccines. 

e We have implemented and continue to experiment with signals that we can use -- around specific kinds of 
sharing behavior, specific page types, and specific types of language, among other factors -- to demote 
content that we predict will contain low quality information. 


Increasing Transparency 

We will continue to seck to ensure the actions we are taking (as well as misses) are apparent and diseernible by people who doit 
work at Facebook. We are especially keen to discuss with you what form shared data could take mn order to be most valuable to 
analysts and researchers. both inside and outside of government, 


Tn terms of what we're doing now: 

e We already have a wide amount of data available for analysis through our academic partnerships like FORT, 
but we are keenly aware that more kinds of data, or more specific cuts, may be valuable to the people actively 
looking to study this area more closely. We also share data with the public through our quarterly Community 
Standards Enforcement Report releases, most recently this past Wednesday, and have also just launched a 
Widely View Content Report to further increase transparency with the public. 

e We are currently deep in internal discussions to identify the best ways we can share with the public information 
about some of the most widely viewed content on Facebook. We're actively considering how we can best 
share that information so that it is valuable to the public and to researchers, which to the best of our knowledge 
no other company provides. 

e We're also looking at ways we can produce more data and deeper data sets that can create richer 
opportunities for researchers to analyse the reach of various kinds of content. 

e We have examined the distribution patterns of the so-called ‘Disinfo Dozen’ (as above - https://about.fb.com 
Mnews/202 1/08/taking-action-against-vaccine-misinformation-superspreaders/ ). 

e To advance public understanding of how social media and behavioral sciences can be leveraged to improve 
the health of communities around the world, we've supported researchers attempting to understand social 
media’s role in the ongoing pandemic. One report has already been published, and we are pleased to see that 
social media can have positive impacts on public health needs. There are other researchers we are 
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supporting, and look forward to reviewing their work as it is completed and peer reviewed. 

e While separate from the issue of content online, researchers are also able to access our COVID-19 Trends 
and Impact Survey, which is a global survey gathering insights about symptoms, testing, mask-wearing, social 
distancing, mental health, vaccine acceptance, reasons for vaccine hesitancy, and more. We believe this is 
the largest public health survey in history. Over 70 million responses from more than 200 countries and 
territories have been collected, and the data can be broken down by self-reported demographic information like 
gender and race as well as by hyper-local geographic regions. The data is available in near real-time and is 
collected off-platform by acadernic partners at the University of Maryland (UMD) and Carnegie Mellon 
University (CMU). Academic and nonprofit researchers are able request access to non-public, non-aggregated 
survey data for their research. 


Lhope this is a useful update. pending further work and discussions we will continue to update vou and your teams and we are 
happy to meet and discuss anv of the work we have outlined here. Please do not hesitate to reach out to me or my team with any 
further questions. 


Best wishes. 


Nick 
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Exhibit 79 


Internal Facebook text thread 


</O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
——— D8F2FABOF4236A38CD9150799E9DE- 


From: 


To: 


Sent: 7/21/2021 10:15:25 AM 
Subject: Message summary [{"otherUserFbld":null, "threadFbld":5772876049449439}] 


>Hey team - know everyone is neck deep right now in WH response. Flagging | <a 
and coer teat aeRO oe at we're being asked to join the WHO call tomorrow, they are 
likely going to have s about the Disinfo Doz recent NewsGuard reports. We've 
nominated Will to p for us - he'll stay « = with the latest your teams ve pulled 
together but wanted to be sure you had viz free to flag any concerns with doing 
this 


(7/21/2021 09:28:49 PDT): 
okay thanks - we are working on a response to the NewsGuard report that we can share later 


Pa (7/23/0031. DS:2BeS) BOR) « 


st - thank you! All our convos with them are off the record completely so def no risk 
s. We'll keep you updated though and be sure to use your messaging docs. Good luck 


ea 
Tas. . 

with the meeting today Sa 

Ce 67/21/2021 10:06:38 PDT): 


still being published today? 


>Yep, its live now but ended up being heavily edited and much more combative than we 


-covid-misinformation-killing-people-facehooks- 


{21/2021 10:09%26 PDT): 
sls the guidance to still hold on doing any further internal comms to xfn? 


(7/21/2021 10:10:49 PDT): 


>I think so for now, just while we deal with current incoming b Dz _ 


correct me if I'm wront 


>no worries we dont need to rush this its not urgent 


7/21/2021 10:14: PDT) : 
>yep that;s the guidance for now 


10:14:34 PDT): 
thank you 


(7iA2LF 2023. LOVISI25 BHT) s 
We can chat more morrow but I assume I should stick to TPs on Disinfo Doze 
Newsguard (forthcoming). THey're under NDA so I assume I'm fine to discuss 


apparently have asked about? 


and 
which they 
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Exhibit 80 


Internal Facebook email 
correspondence 


643 


From: </O=THEFACEBOOK/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FY DIBOHF23SPDLT)/CN=RECIPIENTS/CN=NELLMDD4> 

To: Nick Clegg; 

ce: 

Sent: 7/21/2021 11:35:35 AM 

Subject: Covid misinfo: Delta assessment + Mitigations 

Nick, 


TLDR: There is likely a significant gap between what the WH would like us to remove and what we 
are comfortable removing. There are some policy mitigations that could get the two parties closer, but 
Content Policy does not recommend pursuing them. 


You asked for information about the delta between content that Facebook is removing and the White 
House wants us to remove and mitigation options. The White House rarely provides any specificity 
about what it wants removed, but if routinely complains to us about content identified in critical media 
reports. We've compiled specific criticisms and extrapolated from more general complaints below: 


1. Cross-platform disables: 

a. Delta: The WH wants cross-platform disables. We only do cross-platform disables for 
child safety and dangerous organization violations. 

b. Mitigation (not recommended): We could remove all of a person's groups/pages/accounts 
once they have had a single group/page/account removed for covid misinfo violations. This 
would remove approximately £0 non-violating entities associated with the Disinfo Dozen, 
including many entities that have nothing to do with COVID or vaccines. We are continuing 
to research what other entities might be affected. 

¢, Backgrounc: 

1. Jen Psaki said that if you’re banned on one platform, you snould be banned on all 
platforms. We do not and should not ban users from FB or IG because they've been 
banned by competitors. We assess FB pages and profiles and IG accounts based 
on tne content they post and do not typically enforce against a non-violating 
page/profile/account if a connected entity is removed (we only enforce cross-platform 
on DOI and Child Safety violations). This practice has been a point of contention 
around the “Disinfo Dozen” because we have removed their violating entities (23 
entities from 11 of the 12 people) but continued to allow their non-violating entities 
(53 entities - this set is under constant review and number changes often). 

|. Off-Platform Links: 

a. Delta: The WH wants all links to the Disinfo Dozen’s off-platform domains removed. We 
only remove links to off-platform content if the content violates child safety or dangerous 
organizations violations. 

b. Mitigation (not recommended): We could remove all posts from FB/IG if the posts contain a 
link to domains associated with covid misinfo violators, but it would likely remove significant 
amounts of benign content posted by regular users, such as their posts about person 
experiences or government criticism that also include a link to a wedsite. Some of the 
off-FB/IG websites also have non-covid-related content, so we could be removing posts that 
are not about COVID and link to the websites for non-COVID reasons. It is unlikely that we 
have capacity to review individual off-olatform links, so we would likely have to execute at a 
domain level. 

c, Background: 

1. To get to the claim that 65% of covid misinfo comes from the Disinfo Dozen, we assume 
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the WH is complaining about non-violating content on FB that includes links to content 
off FB that would violate if posted on FB. 

. We could blackhole links to any domain or sub-domain associated with pages, groups, 
or accounts removed for violating our covid misinfo policies. We are currently 
investigating the impact that this change would have, including both scope of removals 
and how much of the content would be benign. Given resource constraints, we do not 
think it is feasible to review all pages before removal. 

. We are still collecting information on how much content this would remove and a rough 
estimate of what percentage of that content links to benign versus violating content. 

3. True information: 

a. Delta: The Surgeon General wants us to remove true information about side effects if the 
user does not provide complete information about whether the side effect is rare and 
treatable. We do not recommend pursuing this practice. 

b, Mitigation (not recommended): We currently label all of this content and demote some of it. 
We could remove the content or increase the demotion strength. 

ce. Background: 

i. The Surgeon General's report on misinformation defines misinformation as including: 
“An anecdote about someone experiencing a rare side effect after a routine surgery. 
The specific anecdote may be true but hide the fact that the side effect is very rare and 
treatable. By misinforming people about the benefits and risks of the surgery, the 
anecdote can be highly misleading and harmful to public health.” 

. Experts have advised us that it’s important to allow people to ask questions and allow 
open discussion of vaccine safety and efficacy to overcome vaccine hesitancy. For 
content that is presented in a sensational or shocking way or promotes vaccine refusal, 
we demote the content and apply a label with a link to accurate, authoritative 
information. We believe the information push partially combats the incomplete 
information while giving users space to express their views and share their personal 
experiences. 

4. Other Vaccine Hesitant Content: 

a. Delta: The WH generally objects to content that appears in media criticism of our covid 
misinfo efforts. While we don't have specifics, we can extrapolate that they would like us to 
remove content that provides any negative information on or opinions about the vaccine 
without concluding that the benefits of the vaccine outweigh that information or opinion; 
humorous or satirical content that suggests the vaccine isn't safe 

b. Mitigation: Similar to true information, we recommend adhering to expert advice that we 
allow open discussion of vaccine safety and efficacy and do not recommend removing this 
content. We could consider increasing the demotion strength on content being demoted 
that is still breaking through into top posts. 

e. Background: 

1. We reviewed a recent report, titled Facebook has a vaccine misinfo problem, that 
concluded 12 of the top 15 vaccine-related posts on Facebook in a one-month period 
were “negative.” We replicated the report’s Crowdtangle search to review the content. 
None of the content or users relate to the “Disinfo Dozen.” Of note, in order to maintain 
the narrative of FB’s failure, our critics remove UNICEF content from their analysis 
because it effectively dominates covid content -- an accurate report on covid content 
from this Crowdtangle search would show that 5 of the top 15 posts were authoritative, 
pro-vaccine posts from UNICEF. 

. None of the content should have been removed. Five pieces of content labeled 
“negative” are being demoted for being vaccine hesitant. Six pieces of content labeled 
“negative” are non-violating -- one is an ABC News report; two are personal opinions 
opposing mask and vaccine mandates; and two are personal opinions about the 
speaker's decision not to get vaccinated. Four pieces of content are labeled “positive” 
or “neutral.” There is a full content assessment below. 
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Detailed Assessment of Other Vaccine Hesitant Content: 

1. The #2 ranked content is an ABC News report about side effects. It is deemed “negative.” 

a. Delta assessment: We don't know whether the WH would propose that this 
reporting from network news should be removed for accurately reporting on side 
effects. We do not recommend doing so. 

2. Five pieces of content (ranking 1, 5, 7, 13, 14} were borderline content and were demoted and 
labeled, but the demotion strength did not remove them from the top 100 FB posts for the 
relevant time period. All received the label: “COVID-19 vaccines go through many tests for 
safety and effectiveness and are then monitored closely” with a link to FB’s COVID-19 
Information Center. 

a. Delta assessment (content assessment below): We suspect the WH believes this 
content should be removed. We demote and label this content because we find it 
irresponsible in its sensationalism and lack of context; however, it is a mix of true 
content and criticism of the government, both of which are appropriate to allow on 
platform. 

b. #1, 5, and 7 are from Candace Owens and suggest that the vaccine is experimental 
or has side effects, including death, and are critical of the government. #5 was also 
fact-checked by a 3PFC. 

c. #13 is from Tucker Carlson and offers sensationalized reporting on a true incident of 
a 12 year old suffering a rare side effect and and reporting on a study published in 
the Journal of the American Medical Association (JAMA) Pediatrics about the 
dangers of wearing masks to children. The content was posted the day after the 
JAMA study was published. JAMA retracted the study two weeks after publication. 

d. #15 is from Turning Point USA and suggests that the government has no authority to 
mandate taking an experimental vaccine. 

2. Five pieces of content (ranking 4, 6, 8, 11, 12) were labeled negative. 

a. Delta assessment (content assessment below): The WH has previously indicated 
that it thinks humor should be removed if it is premised on the vaccine having side 
effects, so we expect it would similarly want to see humor about vaccine hesitancy 
removed. Ve don’t have insight into whether the WH wants personal opinions about 
government mandates or explanations of personal choices not to get the vaccine 
removed. We believe there is a strong interest in protecting the expression of 
personal opinion and personal choice. 

b. #4 is a cartoon attempt at humor, suggesting that door-to-door vaccinators would be 
tied to trees. 

c. The other four pieces of content ail offer personal opinions about mask or vaccine 
mandates or the decision to be vaccinated. 

4. Four pieces of content {ranking 3, 9, 10, 15} were labeled positive or neutral. 


Disinfo Dozen Status On Platform: 

1. We have been aware of the Disinfo Dozen back in March. We took very aggressive actions 
based on them, and other entities we flagged, by expanding the amount of Misindo that we 
remove and by giving the “Worst of the Worst” entities 48 hours to remove all violating 
misinformation or otherwise they would be removed. As a result of that, we removed known 
anti-vaxxers such as RFK Jr.’s IG Account. 

. This resulted in behavior modification by these actors -- RFK stopped posting anti-vax content 
on his FB page, and some other members of the Disinfo Dozen also stopped posting violating 
content. 

3. We have continued to monitor these accounts and have found the following: 

a. 91 entities are tied to the Disinfo Dozen (however, the majority of these entities do not 
share anti-vax content and some post infrequently or stopped posting altogether). 


lo 
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b, 23 of those entities have been removed. 


c. We are confirming additional entities (approx. 15) that may be removed under our “Single 
Use Multiple Account” and Recidivism policies (we are aiming to have these results by 
EOD). 

d. 11 of the 12 Disinfo Dozen members have had one entity removed by us. The 12th posts 
mainly about internet censorship now. We are watching his profile closely. 
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Exhibit 81 


Email correspondence between 
Facebook and the White House 


648 


From: HE <= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob R. EOP/WHO 

ce: Waldo, Eric (HHS/OASH); Rowe, Courtney M. EOP/WHO; 
Sent: 9/21/2021 11:15:04 AM 

Subject: Re: [EXTERNAL] Covid Insight Report 


Understood Rob—we will circle back over the next few days to brief. 


From: Flaherty, Rob R. EOP/WHO <M Qwho.eop.gov> 
Date: Saturday, September 18, 2021 at 2:54 PM 
To: ES fb.com> 


Ce: Waldo, Eric (HHS/OASH) hhs.gov>, Rowe, Courtney M. EOP/WHO 
<0. 00. gov>, gmail.com> 


Subject: Re: [EXTERNAL] Covid Insight Report 


Happy to talk about it would be interested to see, as we have long asked for, how big the problem is, what 
solutions you're implemerting, and how effective they've been. 


Sent from my iPhone 


On Sep 18, 2021, at 2:52 PM, fb com> wrote: 


Eric and team, 
Including the latest version of our report here. 


[°m sure you also saw yesterday's story in the WSJ about the spread of COVID-19 misinformation in comments 
on Facebook. The story - largely based on cherry-picked leaked documents, doesn't accurately represent the 
problem or the solutions we have put in place to make comments on posts about COVID and vaccines safer | 
know that we've discussed this many times over the past several months and I°d be happy to schedule a call to 
discuss in greater detail. Please let me know if that would be of interest. 


In the meantime I'm also sharing a post we published today from Nick addressing the WSJ series in full. Link to 
that post Is here. 


As always please let me know if you have any questions 


Thanks, 

From: Waldo, Eric (HHS/OASH) <a nhs. gov> 
Date: Tuesday, September 7, 2021 at 5:11 PM 

To: fb.com>, 


who.eop.gov 4 @who.eoo.gov>, 
Rowe, Courtney (who.eop.gov} who.eop.gov>, @gmail.com> 
Subject: RE: Covid Insight Report 
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Thanks so much for sharing this, a Gen: | connected last week and he should be reaching out with timing 
soon {me or someone from my team would join him as well. 


Thanks! 


From: iE © f.com> 
Sent: Tuesday, September 7, 2021 10:03 AM 


To: Waldo, Eric (HHS/OASH @rhs.gov>; @who.eop.gov; Rowe, Courtney 
(who.eap.goyv) < who.eop.gov>; gmail.com> 
Subject: Covid Insight Report 


Good moming—apologies that this is coming after the holiday weekend. Attaching our latest Covid Insights 
report. Happy to schedule time to discuss at your convenience. 


Eric and fi woud also love to follow up on railing down our meeting to discuss data transparency—let me know 
if there’s anything | should be doing to move that along. 


Thanks, 
| | 


From: EE f12.com> 
Date: Saturday, August 21, 2021 at 1:10 PM 


To: Waldo, Eric (HHS/OASH) <f@hhs.gov>, 


Subject: Covid Insight Report - 8/20 


Eric, Courtney and Rob, 


Attached please find the latest version of our Covid Insights report detailing the top 100 posts overall and related 
to the vaccine for the weeks of 7/25 and 8/1. 


Happy to schedule time to follow up on any questions you might have. 
Thanks, 


<9_17 - COVID-19 Insights. pdf> 
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Exhibit 82 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy’s office 


From: Flaherty, Rob R. EOP/WHO SE 110. c0p.gor~ 

To: aa Waldo, Eric (HHS/OASH); Rowe, Courtney M. EOP/WHO; 
Sent: ! 2:39:18 PM 

Subject: RE: Cowd Insight Report 


Appreciate it 


Figure you'd have other things to deal with today! 


From: fb.com> 
Sent: Monday, October 4, 2021 4:04 PM 


To: Waldo, Eric (HHS/OASH) <otns.gov>; Flaherty, Rob R. EOP/WHO 
< who.eop.gov>; Rowe, Courtney M. EOP/WHO <{o wno.ecop.gov>: 


< pgmaill.com> 
Subject: [EXTERNAL] Re: Covid Insight Report 


Hi Eric, Rob, Courtney and jj 


Apologies that this is coming to you today instead of Friday—my fault for not getting it cut earlier. Attached is the 
latest version of our bi-weekly Covid Insight report. 


Please let me know if you have any questions related to the report or on anything else that we might be able to be 
helpful with. 


Thanks, 


From: EE 1 com> 


Date: Saturday, September 18, 2021 at 2:51 PM 


To: Waldo, Eric (HHS/OASH) <iiiiionns.gov>, who.eop.gov 
who.eop.gov>, Rowe, Courtney (who.eop. gov) who.eop.gov>, 


gmail.com> 
Subject: Covid Insight Report 


Eric and team, 
Including the latest version of our report here. 


[°m sure you also saw yesterday's story in the WSJ about the spread of COVID-19 misinformation in comments 
on Facebook. The story - largely based on cherry-picked leaked documents, doesn't accurately represent the 
problem or the solutions we have put in place to make comments on posts about COVID and vaccines safer | 
know that we’ve discussed this many times over the past several months and Id be happy to schedule a call to 
discuss in greater detail. Please let me know if that would be of interest. 


In the meantime I'm also sharing a post we published today from Nick addressing the WSJ series in full. Link to 
that post is here. 


As always please let me know if you have any questions 


Thanks, 
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From: Waldo, Eric (HHS/OASH) <i @ hhs. gov> 
Date: Tuesday, September 7, 2021 at 5:11 PM 


To: @fb.com>, Robert.Flaherty@who.eop.gov < who.eo0.gov>, 
Rowe, Courtney (who.eop.gov} < who.eop.gov>, gmail.com> 
Subject: RE: Covid Insight Report 


Thanks so much for sharing this, I fenc | connected last week and he should be reaching out with timing 
soon {me or someone from my team would join him as well}. 


Thanks! 


From: t>.com> 
Sent: Tuesday, September 7, 2021 10:03 AM 


To: Waldo, Eric (HHS/OASH} < rhs.gov>: who.eop.gov; Rowe, Courtney 
{who.eop.goy} who.eop.gov>; @gmail.com> 
Subject: Covid Insight Report 


Good moming—apologies that this is coming after the holiday weekend. Attaching our latest Covid Insights 
report. Happy to schedule time to discuss at your convenience. 


Eric and Bi woud also love to follow up on railing down our meeting to discuss data transparency—let me know 
if there’s anything | should be doing to move that along. 


Thanks, 


From: Eb com> 


Date: Saturday, August 21, 2021 at 1:10 PM 


To: Waldo, Eric (HHS/OASH) <a bhs.gov>, who.eop. gov 
Qwhno.eop.gov>, Rowe, Courtney M. EOP/AWHO < who.eop.gov> 


Subject: Covid Insight Report - 8/20 


Eric, Courtney and Rob, 


Attached please find the latest version of our Covid Insights report detailing the top 180 posts overall and related 
to the vaccine for the weeks of 7/25 and 8/1. 


Happy to schedule time to follow up on any questions you might have. 


Thanks, 
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Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy’s office 
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From: </O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 


/CN=70251C0920BB487E8111461E3692A624> 


To: Waldo, Eric (HHS/OASH); BE 2 0. c0p.gov; Rowe, Courtney (who.eop.gov); mm 
Sent: 10/17/2021 4:05:20 PM 

Subject: Covid Insight Report 

Attachments: 10_15 - COVID-19 Insights[32].pdf 


Eric, Rob, Courtney and ij 
Including the latest Insight report here for your review. 


We also wanted to provide you with a brief update on our proactive efforts on COVID. We continue to focus our 
efforts on reaching low-vaccination communities. This includes our partnership with the U.S. Department of 
Health and Human Services (HHS), where together we're working to amplify influential voices in 
low-vaccination communities. Earlier this month, we partnered with the Center for Disease Control to run a 
campalgi to Spanish speaking users to drive usage of their Spanish language vaccine sclduianse hotline. Our 


we've recently been een Sic ccslanie. to drive vaccine aipbor and aw ‘areness in low-vax communities. 


Looking forward, we are exploring ways we can help parents get their.kids vaccinated in preparation for the FDA 
approval of vaccines for under 12 population. We are also supporting partners at Johns Hopkins University and 
Mayo Clinic with flu vaccination campaigns, building on SHE CCRSTUL results from last year. We look forward to 
sharing more with you on these efforts soon. : 


We also wanted to share some studies we've been ninning with partners that are informing both our approach, 
and helping us better understand what works and what.doesn’t. Details on this below: 


« CARE US ran a campaign designed to promote COVID-19 vaccine acceptance that featured faith leaders, 
healthcare professionals, and celebrities. They found that faith leaders were the most effective messengers. 
the campaign significantly increased beliefs that COVID-19 vaccines were safe based on their 
measurements: +7.9 point lift among 25-34 year old men and +16.4 point lift among 35-44 year old 
women), CARE also used" the campaign to drive traffic to a vaccine information page on their website. 
From there, viewers could click through to the CDC’s website where people can book a vaccine 
appointment. More details here. 
Direct Relief released the results of an online Facebook campaign aimed to promote the COVID-19 
vaccine in the United States and found that messages on social norming, social responsibility, and the purity 
value can all be effective at combating vaccine hesitancy. The social norming ad yielded the strongest 
statistically significant results across all of the survey's questions, Improving perceptions of vaccine safety, 
the perceived social approval associatec with getting a vaccine and improving the frequency of people 
recommending that their friends talk to a doctor if they had questions. More details here. 
¢ Last year around the holiday season, Facebook partnered with a team of doctors and nurses who recorded 
short social media videos urging people to stay home and avoid travel around Thanksgiving and Christmas 
a) slow the spread or Cc OVID-19, Nobel Laureates recently completed analysis of this campaign and 
Medicine showing that it led to a significant reduction in holiday travel and 
subsequent COV ID-19 in ections. 
¢ Finally, partners at Stanford and UNC recently produced PSAs designed to increase vaccine uptake in 
states with low vaccination rates. One PSA featured Donald Trump endorsing the vaccine. It also 
referenced that he had received the vaccine himself. The researchers’ preliminary analysis indicates that 
counties that recerved the Trump ad saw increased vaccination rates. They are currently developing the 
study draft for publication, but are happy to share more details directly if you are interested. 
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Happy to follow up on anything included above or on any other topic of interest. 


Thanks, 


From: i > com> 
Date: Monday, October 4, 2021 at 4:03 PM 


To: Waldo, Eric (HHS/OASH) <iiienhs.gov>, who. eop.gov 
@who.eop.gov>, Rowe, Courtney (who.eop. gov) @who.eop.gov>, 


gmail.com> 
Subject: Re: Covid Insight Report 


Hi Eric, Rob, Courtney and Rr 


Apologies that this is coming to you today instead of Friday—my fault for not getting it cut earlier. Attached is the 
latest version of our bi-weekly Covid Insight report. 


Please let me know if you have any questions related to the report or on ate else that we might be able to be 
helpful with. 


Thanks, 


From EE 2% cor pee 
Date: saturday, September 18, 2021 at2:51PM .. 
To: Waldo Eric (HHS/OASH) RS » hs. gov>, @who.eop.gov 
who.eop.gov>, Rowe, Courtney Coo 


gmail. com> 
Subject: Covid Insight Report 


x 


Eric and team, 
Including the latest version of our report here. 


I’m sure you also saw yesterday's story in the WSJ about the spread of COVID-19 misinformation in comments 
on Facebook. The story - largely based on cherry-picked leaked documents, doesn't accurately represent the 
problem or the solutions we have put in place to make comments on posts about COVID and vaccines safer. | 
know that we've discussed this many times over the past several months and I'd be happy to schedule a call to 
discuss in greater detail. Please let me know if that would be of interest. 


In the meantime I'm also sharing a post we published today from Nick addressing the WSJ series in full. Link to 
that post is here. 


As always please let me know if you have any questions 


Thanks, 


From: Waldo, Eric (HHS/OASH) <{—@nhs. cov> 
Date: Tuesday, September 7, 2021 at. 5:11 PM 


To: O' com> 


Who.eon.gov>, 
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Rowe, Courtney (who.eop. gov} RE 2 :0.200.g0v>, DJ Patil Fe gmail.com> 


Subject: RE: Covid Insight Report 


Thanks so much for sharing this, nie DJ anc | connected last week and he should be reaching out with timing 
soon{me or someone from my team would join him as well}. 


Thanks! 


From: fb.com> 
Sent: Tuesday, September 7, 2021 10:03 AM 


To: Waldo, Eric (HHS/OASH ths.gov>; BE who.eop.gov; Rowe, Courtney 
(who.eop.goy) < who.eop.gov>; DJ Patil < 


fe ail.com> 
Subject: Covid Insight Report 


Good morming—apologies that this is coming after the holiday weekend. Attaching our latest Covid Insights 
report. Happy to schedule time to discuss at your convenience. 


Eric and DJ—would also love to follow up on railing down our meeting to discuss data transparency—let me know 
if there’s anything | should be doing to move that along. 


Thanks, 


Date: Saturday, August 217, 2021 at 1:10 PM eee 
To: Waldo, Eric (HHS/OASH) TB crs | who.eop. gov 
ourtney M: oe 


who.eop.gov>, Rowe, 
Subject: Covid Insight Report - 8/20 


Eric, Courtney and Rob, 


Attached please find the latest version of our Covid Insights report detailing the top 100 posts overall and related 
to the vaccine for the weeks of 7/25 and 8/1: 


Happy to schedule time to follow up.on any questions you might have. 


Thanks, 
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From: aay </O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Waldo, Eric (HHS/OASH) 
Sent: 8/23/2021 7:13:45 PM 
Subject: FW: FDA Approval 


Eric—making sure to flag for you as wellLlet me know if you have any questions. 


From: Si <I @'b.com> 

Date: Monday, August 23, 2021 at 10:12 PM 

To: Flaherty, Rob R. EOP/WHO <{ Qwho.eop.gov> 
Subject: Re: FDA Approval 


Rob—wanted to circle back with you before the end of the day with an update--this week, we plan to run a QP in 
the US that amplifies authoritative partner content related to Pfizer’s FDA approval (example content is below). 
We're also planning to review our existing products, including the Covid information center, to update any language 
as needed. Our partnerships team is also working with partners who are launching campaigns around the Pfizer 
approval to support. We'll keep you updated on this as it progresses. 


We're also updating our misinformation policies to remove the specific claims that “there are no FDA-approved 
vaccines” and “the Pfizer vaccine is not FDA-approved.” We'll also continue to look for claims that are no longer 
accurate given the approval today.” 


More to come as we have it, and let me know if you have any questions. 


Thanks, 
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ana Ga G 3:29 


FACEBOOK 90890 "4 


FDA fully approves the Pfizer 
COVID-19 vaccine for people aged 16 
vears and older 


The vaccine is still available under emergency use 
authorization for those 12 to 15 vears old 


& | 


> US. Food and Drug Administration - 8 hrs 
FDA Approves First COVID-19 
Vaccine 


14K Shares 


f Fox Business 8 hrs 
FDA grants Pfizer COVID-19 vaccine § 
full approval 


98 Shares 


© Washington Post: 8 hrs 
Pfizer-BioNTech coronavirus vaccine 
gets full FDA approval, potentially 
pene the hesitant to get a sh... 


K Share 


Get COVID-19 Info > 


Why arm! seeing this? Learn More 


From: Flaherty, Rob R. EOP/WHO <fEE @who.eop.gov> 
Date: Monday, August 23, 2021 at 9:44 AM 


To: i 1 com- 


Subject: FDA Approval 
a - 


Now that FDA has approved Pfizer, I’m making the rounds to get a sense from the various platforms how (or if) 
you guys are planning to promote it in any way 


We'd appreciate a push here, given the fact that this is an oft-cited blocker for many folks. 


Suggested language from us: 
The COVID-19 vaccine has received full approval from the FDA and protects against the more dangerous 


delta variant. If you have been waiting for this approval before getting the vaccine, now is the time to get 
vaccinated. 


Thanks! 
-Rob 


Rob Flaherty 

Director of Digital Strategy 
The White House 

Cell: 
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Exhibit 85 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy’s office 


From: GR < (= THHEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Waldo, Eric (HKS/OASH} 
Sent: 10/31/2021 1:43:30 PM 
Subject: Fwd: not even sure whai to say at this point 


Eric—we had heard from Rob Thursday as well regarding Thursday's wapo story (my response below). I saw the 
Surgeon General’s reaction on Twitter—we want to make sure you and he have the context necessary as we feel 
strongly that the claims made in the story are not accurate, especially considering that we had discussed many of 
the studies referenced during our briefings. 


Please let me know if you'd have time for a longer conversation next week. 
Thanks, 


Get Outlook for iOS 


Form: 5 corn> 
Sent: Thursday, October 28, 2021 11:58 AM 

To: Flaherty, Rob R. EOP/WHO 

Subject: Re: not even sure what to say at this point 


Hey—nothing in the story is inconsistent with what we briefed on. The studies referenced in the story were all 
done early and were not in any way considered to be methodologically appropriate for sharing. We referenced 
these in bnefings and also talked about why we were not comfortable using this type of data because It’s 
unreliable. This has been a fundamental disagreement to be sure in terms of data you have asked for and data 
that we have said is best used to depict the scope of the issue. But we've been open about that. A number of 
these studies cited in the story were specifically referenced during our briefings. Happy to get on the phone to 
walk through why this story is not accurate—like much of the coverage in recent days it relies on cherry picked 
data that portrays a specific narrative. In the meantime, here's the statement we just released: 


“The studies cited were in no way definitive. which is why we did not share them as if they were. They were 
early directional analyses meant to give guidance to product and policy teams on where we could improve our 
defenses against harmful vaccine misinformation. We improved our policies based in part on those analyses and 
communicated those steps to policymakers and the public. As VP of Integrity RE noted in August, 
measuring prevalence of a specific type of content on our platform takes years of work - especially on a topic as 
dynamic as vaccine misinformation - which 1s why no company has to date been able to share that data.” 


Get Outlook for 10S 


From: Flaherty, Rob R. EOP/WHO (EEE ow10.cop.gov> 


Sent: Thursday, October 28, 2021 10:09:04 AM 
To; I 2. com> 


Subject: not even sure what to say at this poirt 


https /Awww.washinatonpost.com/technology/2021/10/28/facebook-covid-misinformatior/ 
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Rob Flaherty 

Director of Digital Strategy 
The White House 

Cell: 
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Exhibit 86 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy’s office 


664 


From: a Eric (HHS/OASH} Bo iis. gov 


To: Nick Clegg 
Sent: 11/3/2021 11:57:44 AM 
Subject: RE: Our announcement 


Hi 
Thanks for your note. | really appreciate it. 


Let me get back to you next week once we are done crashing on our rollout for vaccines 5-11. 


Allthe best, 
Eric 


From: fb.com> 

Sent: Friday, October 29, 2021 9:42 PM 

To: Wallo, Eric (HHS/OASH) <iiiiferhs gov>; Nick Cleag <otb com> 
Subject: Re: Our announcement 


Thanks Eric—we’d appreciate the opportunity ‘o meet and discuss concerns you have related to the recent press 
reports. We feel strongly that much of the reporting is based on documents that have been taken out of context 
and dor'’t tell the full story of our work. Please let me know if you'd have time to connect next week. 


Thanks—have a good weekend. 


Get Outlook for iOS 


From: Waldo, Eric (HHS/OASH) <a hs. gov> 


Sent: Friday, October 29, 2021 10:18 AM 


To: Nick Clegg: KEE 


Subject: FW: Our announcement 
Good afternoon, Nick and 


| hope this email finds you well. I'm back from my paternity leave stint and getting my sea legs in the office witha 
six week old at home. 


Thank you for this note to Dr. Murthy, Nick. | did want to say that we have seen the recent public reports around 
Facebook and misinformation. We are certainly concerned about what we are seeing, given our emphasis on 
health misinformation in our advisory and the ongoing conversations our teams have been having. As has been the 
case, you'll continue to see us raising the issue of health misinformation in public and private as a critical public 
health issue. 


Allthe best, 


Eric 


From: Nick Clegg = 
Date: October 28, at 6:31:51 PM EDT 
To: "Murthy, Vivek (HHS/OASH)" <R @hs.gov> 
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Subject: Our announcement 


Dear General Murthy. 


[hope vou are well. Its been a while since we connected. I know our teams have remained in close contact with respeet to our 
work to provide authoritative mformation about the vaceine and we are working on how we can partner in this next push to 
vaccinate children, We appreciate the opportunity to partner with your team. 


I also wanted to be in touch to update vou on an announcement we made today. Mark announced that we will have anew company 
orand - Meta - which signals our conrmitment to build the next evolution of social technology - bevond what digital connection 
makes possible today. We believe the ullimate promise of technology is to inrprove people's lives. With the metaverse. we see the 
opportunity to bring people together in wavs never before possible in the next decade. We are starting this conversation carly so that 
we can make sure it’s built on solid foundations when tt comes to things like privacy. safely. and economic opportunity. 


While we are looking to the future. our mission hasnt changed. and neither has the sense of responsibility that we have to the 
billions of people who use our apps and services every das. We're proud of our record navigating the complex tradeolfs involved in 
operating services at global scale. and of our massive investments in safety and security. We alse continuc to believe more 
regulation is necessary. We are on the cusp of anew cra of technology but - in many countries - we still doit vet have rules in place 
for this one, 


As we begin to work on the next evolution of technology and of our companys. | wanted to let you know and make myself available 
to hear vour thoughts. questions. and feedback. We know the metaverse can be hard to grasp - not unlike trying to describe the 
World Wide Web in the early 1990s - but we believe this technology will be an important part of our collective future. and it is 
something that we will all be building together. 


| also recognize the intense debate that's been prompted by the documents that have been disclosed by a former employee. You and 1 
have touched on the subject of wellbeing in our previous conversations and I know It’s an area of concern for vou and for the White 
House. lwould welcome the opportunity to meet again to hear from vou and to address the claims that have been made against the 
compans. 


Best regards. 


Nick Clegg 


Viee President of Global Affairs and Communications 
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Facebook, the White House, and 
Surgeon General Murthy’s office 
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From: GE «0= THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251 CO20BB487E6111461E3692A624> 


To: Rowe, Courtney M. EOP/WHO 

ce: Flaherty, Rob R. EOP/WHO; Waldo, Eric (HHS/OASH); SM phs.gov 
Sent: 12/30/2021 4:16:50 AM 

Subject: Re: [EXTERNAL] Re: Cov Insights Report - weeks of 10/31-11/13 
Attachments: 12_24 21 - COVID-19 Insights. pdf 


Morning and happy holidays to you all. Sendirg the latest version of our Covid insights report, which covers the 
weeks of 11/28-12/11. 


We'll be back on schedule to send you the next version on Friday 1/7. 


Please let me know if you have any questions or would like to discuss. 


EE 09 Meta 


US Public Policy 


Washington, D.C. 20004 


From: iE Sb .com> 


Date: Wednesday, December 15, 2021 at 1:07 PM 
To: Rowe, Courtney M. EOP/WHO who.eop. gov> 


Ce: Flaherty, Rob R. EOP/WHO who.eop.gov>, Waldo, Eric (HHS/OASH 
hhs.gov>, hhs.gov>, 
fb.com=> i. 


Subject: Re: [EXTERNAL] Re: Covid Insights Report - weeks of 10/31-11/13 


Hi Courtney— 


Apologies for the delayed response. ‘Lwant to make sure we aren't miscommunicating—and if you are thinking of 
a separate campaign other than the one we are currently deploying, | will run that to ground. We're taking a 
multi-prong approach to addressing the Omicron variant and encouraging people to get their booster vaccines, 
including: 


Profile Frames: On Wednesday, December 1, we partnered with HHS to launch a new set of Facebook 
Profile Frames that encourage the COVID-19 booster vaccine. The frames are in both English and Spanish, 
and allow users to share either that they’ve received their booster vaccine (“I Got My COVID-19 Booster’) 
or to encourage getting the booster (“Let’s Get Our Covid-19 Booster”). We have employed platform 
interventions to promote adoption of these frames and will continue to iterate. 


e In Feed Promotions - We ran infeed promotions on Facebook in both English and Spanish, which share 
content created by credible health and media organizations about the Center for Disease Control 
recommerdation for all eligible adults to get their booster vaccine. 


e Ads: In partnership with HHS and Center for Disease Control, we are working to utilize their remaining ad 
credits to raise awareness of the booster vaccine and communicate essential health information. 


¢ Partner campaigns: Next week, we are launching a campaign with Johns Hopkins University’s Bloomberg 
Schoo! of Public Health that will encourage eligible adults to get booster shots. Additionally, our partnerships 
teams continue to encourage public figures and influencers to adopt the HHS Profile Frames, and we 
continue to explore ways of working together to activate these influencers in support of HHS/CDC 
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recommendations. 


« Covid Information Center: We worked with the Center for Disease Control to update language in the Covid 
Information Center’s Frequently Asked Question section, ensuring it accurately mirrors current CDC/FDA 
recommendations regarding the new variant and the booster. 


If there are efforts that you think could be helpful in addition to what we are doing above, I'd appreciate hearing 
from you and the team and I'll follow up with our teams to make sure we are doing what we can. 


00 Meta 
US Public Polic 


ee D.C. 20004 


From: Rowe, Courtney M. EOP/WHO 
Date: Monday, December 13, 2021 at 10:58 AM 


who.eop.gov> 


To: fb.com> 

Cc: Flaherty Rob R. EOP/WHO Re w>. eop.gov>, Waldo, Eric (HHS/OASH) 
| ae I HE a 
< fb.com> 


Subject: Re: [EXTERNAL] Re: Covid Insights Report - weeks of 10131- 413 

Thanks [J How long before you think you'l get the booster campaign off the ground? | saw coming weeks, but 
just wondering if you have a more firm timeline. | think pushing eel is going to increasingly become more 
important given omicron ; 


Sent from my iPhone 


On Dee 13, 2021, at 10:40 AM, [MM tb. com> wrote: 


Morning—including the latest Covid insig hts report here for your review. As always please let us 
know if you have any questions or would like to discuss anything related to our work. 


From: i O'5.com> 


Date: Wednesday, December 1, 2021 at 1:50 PM 


W@who.eop.gov>, Waldo, Eric (HHS/OASH} 
hhs.gov>, Rowe, Courtney M. EOP/WHO MIE 110 200. 50> 
hhs.gov> 


Subject: Covid Insights Report - weeks o° 10/31-11/13 


Rob, Eric, Courtney, Becca— 


Apologies for delay over the holiday weekend—sending our most recent Covid Insights report for weeks of 
10/31-11/13. 


We also wanted to provide you with a brief update on our work both on vaccines for children age 5-11, as well as 
our work on boosters. 


Youth/Week of Action 
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e On the platform, we launched in-feed pramotions featuring content in English and Spanish from authoritative 
health orgs and media about vaccine approval and safety for children ages 5-11. We are currently re-running 
this campaign. We also updated our COVID Information Center FAQ unit with the latest vaccine information 
regarding children ages 5-11. 

e We are supporting Kaiser Family Foundation, Ad Council, and Direct Relief to run large-scale ad campaigns 
aimed at parents that answer questions about COVID-19 vaccines for children, some of which are available 
both in English and Spanish. We have encouraging results back from one of these campaigns indicating that 
it has helped increase perceptions that COVID-19 vaccines are safe and important for children. 


Boosters 
e In the coming weeks, we are launching a campaign with Johns Hopkins University’s Bloomberg School of 
Public Health that will encourage eligible adults to get booster shots, particularly ahead of the holiday 
season. 
e We're working with HHS on a new set of profile frames specifically encouraging people to get their booster 
vaccine. The new frames, which are available in both English and Spanish, will let you share your support for 
COVID-19 booster vaccines, and see that others you respect and care about are doing the same. 


Separately, our teams are reviewing our strategy In light of the emerging Omicron variant of the virus. As additional 
guidance emerges from our authoritative health partners, we'll ensure that information is shared in surfaces like the 
COVID Information Center, as we've done recently with updating guidance on booster eligibility this week. 


As always, please let me know if you have any questions. We'd be happy to, schedule time to cover any of the 
content here. ° te 


<image001.gif> 
US Public Policy 


Nl 
a D.C. 20004 


<12_10_21 - COVID-19 Insights [WIP].pdf> ee 
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Exhibit 88 


Email correspondence between 
Facebook, the White House, and 
Surgeon General Murthy’s office 


From: BR <= THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Rowe, Courtney M. EOP/WHO; S@ who.cop.gov, Manning, Tim W. EOP/WHO 
CC: Flaherty, Rob R. EOP/WHO; Waldo, Eric (HHS/OASH); (IO hhs.gov 

Sent: 2/10/2022 6:18:18 PM 

Subject: Re: Covid Insights report - 

Attachments: 2_4 22 - COVID-19 Insights. pdf 


Apologies for sending this report late—entirely my fault for not getting this to you earlier. Attached is the Insights 
report for the periods dating between 1/09 — 1/22. The next report will be sent on Friday, 2/18. 


Thanks and as always please let me know if you have questions. 


a) © Meta 


US Public Policy 


From: i fb .com> 
Date: Monday, January 24, 2022 at 1:28 PM 
To: Rowe, Courtney M. EOP/WHO <|@who.eop.gov>, 
a eop.gov <_@wio.ecop.gov>, Manning, Tim W. EOP/WHO 
Hh o.cop.gov> oe 
c: Flaherty, Rob R. SEU < RR 2 ho. cop.gov>, Waldo, Eric (HHS/OASH) 
ee gov>, err ED gov \ Os gov> 


Subject: Re: Covid Insights report - 


Attached is the latest Covid Insights Report, which details the top 100 posts overall as well as the top 100 vaccine 
related posts over the periods of 12/26 — 1/8.. 


Overall, of the Top 100 vaccine-related posts vlewed on Facebook in the United States during the week of 
12/26/21 - 01/01/22: 


« OC posts were deleted for violating our COVID-19 and vaccine policies. 
e Oposts were labeled and demoted by third-party fact checkers. 
e Oposts were labeled and demoted upon review. 


Of the Top 100 vaccine-related posts viewed on Facebook in the United States during the week of 01/02/22 - 
01/08/22: 


¢ O posts were deleted for violating our COVID-19 and vaccine policies 

¢ O posts were labeled and demoted by third-party fact checkers 

e 5posts were labeled and demoted uponreview 
°o Two were videos by public figures suggesting that vaccines are ineffective 
° Two were vaccine humor posts whose content could discourage vaccination 
o One was a post by a public figure promoting the Omicron variant as a naiural alternative to the 

COVID-19 vaccine 
Thanks and as always please let me know if you have any questions. 


PE 00 Meta 
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US Public Policy 


From: i <b com> 


Date: Saturday, January 8, 2022 at 5:34 PM 


To: Rowe, Courtney M. EOPAVHO who.eop.gov>, 
Ee 0. cop.gov Dwho.eop.gov>, Manning, Tim W. EOP/WHO 
<BR 0. cop. gov> 


Ce: Flaherty, Rob R. EOP/WHO <I @who.cop.gov>, Waldo, Eric (HHS/OASH) 
ee oe < GEE @)1111s.gov>, Carrie Adams 


fb.com> 
Subject: Covid Insights report - 


Attached is the latest version of our Covid Insights report, covering weeks of 12/12-12/25. 


Of the Top 180 vaccine-related posts viewed cn Facebook in the United States during the week of 12/12/21 - 
12/18/21: 

e CO posts were deleted for violating our COVID-19 and vaccine policies:..-. 

* Oposts were labeled and demoted by third-party fact checkers for.: ‘false information’. 

e Oposts were labeled and demoted upon review. 


Of the Top 100 vaccine-related posts viewed cn Facebook in the United States during the week of 12/19/21 - 
12/25/21: 
* Oposts was deleted for violating our COVID-19 and. vaccine poles 
e Opeosts were labeled and demoted by third-party fact checkers 
¢ 2 posts were labeled and demoted upon review. Both were suggesting natural immunity by COVID-19 
infection is superior to immunity by the COVID-19 vaccine. 


Please let us know if you'd like to discuss. Thanks-and enjoy the rest of the weekend. 


OO Meta 
US Public Policy 


—SSS=z 

From: fb.com> 

Date: Friday, January 7, 2022 at 10:57 AM 

To: Rowe, Courtney M. EOP/WHO < who.eop.gov>, 

ho. cop.gov a. Manning, Tim W. EOP/WHO 


<2 w'20.000. 907 


Ce: Flaherty, Rob R. EOP/WHO < who.eop.gov>, Waldo, Eric (HHS/OASH) 
<b hs.gov>, @hhs.gov i! ODhhs.gov>, Carrie Adams 


<M fb. com> 
Subject: Re: [EXTERNAL] Re: Covid Insights Report - weeks of 10/31-11/13 


Morning, 


Ve'll send our latest updated Covid Insights top 100 report later today. | also wanted to send a quick update on 
the work we aré doing to combat the Omicron wave. Happy to discuss any of these measures or anything else 
that might be on your minds. Ben—l’m running down your questions from yesterday and hope to have a response 
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pack later today as well. 
Our approach continues to evolve on both vaccinations and the Omicron variant and booster vaccines: 


e Partner Campaigns: VVe recently launched several campaigns with partners to bring authoritative 
information to users. This includes a campaign with Johns Hopkins University’s Bloomberg Schoo! of Public 
Health and Ad Council, which is aimed at parents and encourages children's vaccines. We also launched a 
campaign encouraging eligible adults to get booster shots with the Bloomberg Schoo! of Public Health. 
Finally, we kicked off a flu vaccination cempaign with the Mayo Clinic and Johns Hopkins University’s 
Bloomberg School of Public Health. 


¢ Profile Frames: |n early December, we partnered with HHS to launch a new set of Facebook Profile Frames 
in both English and Spanish that encourage the COVID-19 booster vaccine. We have been promoting the 
adontion of these profile frames since mid-December, and continue to do so. 


In Feed Promotions - We are running promotions on Facebook in both English and Spanish highlighting 
content created by credible health anc redia organizations that share authoritative information about both 
Omicron and booster vaccine eligibility. 


e Ads: We continue to work with HHS and CDC on utilizing what remains of the combined $30 million 
allocated in ad credits to raise awareness of the booster vaccine and communicate essential health 
information. Though HHS was unable to accept additional ad coupons, we are supporting national nonprofit 
organizations dedicated to communicating critical vaccine information... re 


BE © Meta 


US Public Policy 


From: i GMO‘. com> 

Date: Wednesday, December 15, 2021 at 1:07 PM 

To: Rowe, Courtney M. EOPAWHO «< ywho.eop.gov> 

Ce: Flaherty, Rob R. EOP/WHO < who.eop.gov>, Waldo, Eric (HHS/OASH) 
(EEE his. gov>, = ‘EEE hhis.gov>, Carrie Adams 
< fb. com> 

Subject: Re: [EXTERNAL] Re: Covid Insights Report - weeks of 10/31-11/13 


Hi Courtney— 


Apologies for the delayed response. | want to make sure we aren't miscommunicating—and if you are thinking of 
a separate campaign other than the one we are currently deploying, | will run that to ground. We're taking a 
multi-orong approach to addressing the Omicron variant and encouraging people to get their booster vaccines, 
including: 


e Profile Frames: On Wednesday, December 1, we partnered with HHS to launch a new set of Facebook 
Profile Frames that encourage the COVID-19 booster vaccine. The frames are In both English and Spanish, 
and allow users to share either that they've received their booster vaccine (“I Got My COVID-19 Booster’) 
or to encourage getting the booster (“Lets Get Our Covid-19 Booster”). We have employed platform 
interventions to promote adoption of these frames and will continue to iterate. 


* In Feed Promotions - We ran infeed promotions on Facebook in both English and Spanish, which share 
content created by credible health and media organizations about the Center for Disease Control 
recommendation for all eligible adults to get their booster vaccine. 
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© Ads: In partnership with HHS and Center for Disease Control, we are working to utilize their remaining ad 
credits to raise awareness of the booster vaccine and communicate essential health information. 


e Partner campaigns: Next week, we are launching a campaign with Johns Hopkins University’s Bloomberg 
Schoo! of Public Health that will encourage eligible adults to get booster shots. Additionally, our partnerships 
teams continue to encourage public figures and influencers to adopt the HHS Profile Frames, and we 
continue to explore ways of working together to activate these influencers in support of HHS/CDC 
recommendations. 


Covid Information Center: We worked with the Center for Disease Control to update language in the Covid 
Information Center’s Frequently Asked Question section, ensuring it accurately mirrors current CDC/FDA 
recommendations regarding the new variant and the booster. 


If there are efforts that you think could be helpful in addition to what we are doing above, I'd appreciate hearing 
from you and the team and I'll follow up with our teams to make sure we are doing what we can. 


| OOMeta 
US Public Policy 


From: Rowe, Courtney M. EOP/WHO Dy ee el 
Date: Monday, December 13, 2021 at 10:5¢ 3 : 


To: EE EEE com> bs 
Cc: Flaherty, Rob R. EOP/WHO who.eop.gov>, Waldo, Eric (HHS/OASH) 
{EE a hns.gov>, @hhs.gov ees gov>, Carrie Adams 


<) fb .com> 
Subject: Re: [EXTERNAL] Re: Covid Insights Report: - weeks of 10/31-11/13 


Thanks [J How long before you think you'l get the booster campaign off the ground? | saw coming weeks, but 
just wondering if you have a more firm aa | think pushing boosters is going to increasingly become more 
important given omicron : 


Sent from my iPhone 


On Dec 13, 2021, at 10:40 AM, I 4Eotb.com> wrote: 


Morning—including the latest Covid Insights report here for your review. As always please let us 
Know if you have any questions or would like to discuss anything related to our work. 


From: {Rb .com> 


Date: Wednesday, December 1, 2021 at 1:50 PM 


ee BE who.cop.cov <_§MMQwho.cop.gov>, Waldo, Eric (HHS/OASH) 
hhs.gov>, Rowe, Courtney M. EOP/WHO <_JQwho.eop.gov>, 


hhs.gov <i @hhs.gov> 
Cc: Carrie Adams <q ib. com> 
Subject: Covid Insights Report - weeks of 10/31-11/13 
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Rob, Eric, Courtney, Becca— 


Apologies for delay over the holiday weekend—sending our most recent Covid Insights report for weeks of 
10/31-11/13. 


We also warted to provide you with a brief update on our work both on vaccines for children age 5-11, as well as 
our work on boosters. 


Youth/Week of Action 

e On the platform, we launched in-feed promotions featuring content in English and Spanish from authoritative 
health orgs and media about vaccine approval and safety for children ages 5-11. We are currently re-running 
this campaign. We also updated our COVID Information Center FAQ unit with the latest vaccine information 
regarding children ages 5-114. 

e We are supporting Kaiser Family Foundation, Ad Council, and Direct Relief to run large-scale ad campaigns 
aimed at parents that answer questions about COVID-19 vaccines for children, some of which are available 
both in English and Spanish. We have encouraging results back from one of these campaigns indicating that 
it has helped increase perceptions that COVID-19 vaccines are safe and important for children. 


Boosters 
e Inthe coming weeks, we are launching a campaign with Johns Hopkins University’s Bloomberg School of 
Public Health that will encourage eligible adults to get booster shots, a ahead of the holiday 
season. 
e We're working with HHS on a new set of profile frames specifically encouraging people to get their booster 
vaccine. The new frames, which are available in both English and Spanish, will let you share your support for 
COVID-19 booster vaccines, and see that others you respect and'care about are doing the same. 


Separately, our teams are reviewing our strategy in light of the. emerging Omicron variant of the virus. As additional 
guidance emerges from our authoritative health partners, we'll ensure that information is shared in surfaces like the 
COVID Information Center, as we've done recently with updating guidance on booster eligibility this week. 


As always, please let me know if you have any questions, We’ d be happy to schedule time to cover any of the 
content here. “ 


| 
US Public Policy 


<image001.gif> 
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Facebook and the White House 
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From: ME «/0=THEFACEBOOK/OU=EXTERNAL {FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 
To: Rowe, Courtney M. EOP/WHO; Manning, Tim VW. EOP/WHO; Wakana, Benjamin L. EOP/WHO; 
. EOP/WHO; Kates, Natalie M. EOP/OMB 


cc: 
Sent: 2/7/2022 7:38:17 AM 
Subject: Re: CovidTests.gov Traffic 


Great—thanks Courtney—look forward to hearing from you. 


From: Rowe, Courtney M. EOP/WHO <2 :.0. 200. gov> 


Date: Friday, February 4, 2022 at 10:37 AM 
To: fo.com>, Manning, Tim W. EOP/WHO 
@who.eop.gov>, Wakana, Benjamin L. EOP/WHO 


, Rob R. EOP/AWHO <0. cop. gov>, 


Subject: RE: CovidTests.gov Traffic 


Thanks for this, [J'm adding Natalie Kates here too. Let us take a look and circle back. 


From: fb.com> 

Sent: Friday, February 4, 2022 8:28 AM 
To: Manning, Tim VW. EOP/WHO < 
< Dwho.eop.qov>: Flaherty, Rob R. 
Courtney M. EOP/WHO < 
Ce: fb.com> 
Subject: [EXTERNAL] CovidTests.gov Traffic 


M@who.eop.gov>; Wakana, Benjamin L. EOP/WHO 


EOP/WHO <i @who cop. gov>; Rowe, 


ho.eop.gov> 


Hi all, 


[ wanted to highlight some data from the first week of covidtests. gov that ] think you'll find interesting, as well as 
a few ideas we have about how to further increase awareness and traffic. 


In January, according to GSA’s Digital Analytics Program, Facebook organically contributed 13.8M visits to HHS 
domain (including covidtests.gov}. In light of that. we wanted to share a few ideas on how we could strategically 
drive traffic from Facebook to the covidtests.gov. 


hd 

* Boosted Posts from Trusted Sources: Using existing organic posts from trusted partners, such 

® as Johns Hopkins University or the Kaiser Family Foundation, we could partner with these sources to boost 
and target their posts to priority audiences. 
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e Ad Campaigns: 

e Partnering with non-government trusted partners (again, such as JHU and KFF}, we could utilize our ads 
platform to deliver targeted messaging to individuals through already-provided ad credits to these 

¢ partners. Since these campaigns are in partner voice, vs. Meta voice, we've found they often resonate more 
with users. The nonprofit advertising partner also controls targeting of the campaigns, and can match 
messaging to target audiences 


Inclusion in the Covid Information Center: Similar to what we did with vaccines.gov (as well 
as 1-800 number in English and Spanish}, we could add covidtests.gov and 1-800-232-0233 to the Covid 
Information Center as an evergreen resource for users. 


We want to make sure we're in lockstep with your teams, particularly to ensure that we're effective in our efforts 
to slow the spread of Covid. If you have any questions about these options, I’m happy to set up time with our 
teams to provide additional details. 
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From: </O=THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=7C251C0920BB487E8111461E3692A624> 

To: Rowe, Courtney M. EOP/WHO; Manning, Tim VW. EOP/WHO; Wakana, Benjamin L. EOP/WHO; 
Flaherty, Rob R. EOP/WHO; Kates, Natalie M. ECP/OME; Lovenheim, Sarah (HHS/ASPA); 


Peck, Joshua {HHS/ASPA) 
ce: 


Sent: 2/7/2022 9:25:39 AM 
Subject: Re: CovidTests.gov Traffic 


Thanks Courtney—very helpful steer, and we'll stay in close contact and will be ready to goif the under 5 is 
approved. 


Get Outlook for 10S 


From: Rowe, Courtney M. EOP/WHO <A 2). 0.200. gov> 


Sent: Monday, February 7, 2022 10:45 AM 

To: Brian Rice; Manning, Tim W. EOP/WHO; Wakana, Benjamin L. EOP/WHO:; Flaherty, Rob R. 
EOP/WHO; Kates, Natalie M. EOP/OMB; Lovenheim, Sarah (HHS/ASPA)}; Peck, Joshua (HHS/ASPA) 
Ce: 

Subject: RE: CovidTests.gov Traffic 


Thanks Ea think the things you outline below on testing are great and we should move forward on if easy to 
execute. As we think about priorities though, | want to make sure that the main focus continues to be on boosters 
and kids vaccinations. I'm looping you here with Sarah and Josh over at HHS who | know are In touch with your 
team already. If we end up getting an under 5 vaccine, that will be a huge priority. Josh/Sarah may want to reach 
out with some additional thoughts they have around kids as we get ready for that potential push. 


Thanks as always, 
Courtney 


From: fb.com> 
Sent: Monday, February 7, 2022 10:38 AM 
To: Rowe, Courtney M. EOPAVHO 


< who.eop.gov>: Wakana, Benjamin L. EOP/WHO <I 
Flaherty, Rob R. EOP/WHO oT ae gov>; Kates, Natalie M. EOP/OMB 
< 


omb.eop.gov> 


who.eop.gov>; Manning, Tim VW. EOP/WHO 
who.eop.gov>: 


Ce: fb.com> 
Subject: [EXTERNAL] Re: CovidTests.gov Traffic 


Great—thanks Courtney—look forward to hearing from you. 


From: Rowe, Courtney M. EOP/WHO <( awho.eop.gov> 

Date: Friday, February 4, 2022 at 10:37 AM 

To: @fb.com>, Manning, Tim W. EOP/WHO 

@who.eop.gov>, Wakana, Benjamin L. EOP/AWHO 

< who.eop. Flaherty, Rob R. EOP/WHO <EEEEEFQwho. cop. gov>, 
Kates, Natalie M. EOP/OMB 
Ce: tb.cam> 
Subject: RE: CovidTests.gov Traffic 
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Thanks for this, ith I'm adding Natalie Kates here too. Let us fake a look and circle back. 


From: fb.com> 
Sent: Friday, February 4, 2022 8:28 AM 
To: Manning, Tim WL EOP/WHO < who.eop.gov>: Wakana, Benjamin L. EOP/WHO 

< whg.e0p gov>. Flaherty, Rob R. EOP/WHO <i @who.cop.gov>; Rowe, 
Courtney M. EOP/WHO < ho.eop.gov> 

Ce: fb.com> 

Subject: [EXTERNAL] CovidTests.gov Traffic 


Hi all, 


[ wanted to highlight some data from the first week of covidtests.gov that ] think you'll find interesting, as well as 
a few ideas we have about how to further increase awareness and traffic. 


In January, according to GSA’s Diuital Analytics Program, Facebook organically contributed 13.8M visits to HHS 
domain (including covidtests.gov). In light of that, we wanted to share a few ideas on how we could strategically 
drive traffic from Facebook to the covidtests.gov. 


Boosted Posts from Trusted Sources: Using existing organic posts from trusted partners, such 
as Johns Hopkins University or the Kaiser Family Foundation, we could partner with these sources to boost 
and target their posts to priority audiences. 


Ad Campaigns: 

Partnering with non-government trusted partners (again, such as JHU and KFF}, we could utilize our ads 
platform to deliver targeted messaging to individuals through already-provided ad credits to these 

e partners. Since these campaigns are in partner voice, vs. Meta voice, we’ve found they often resonate more 
with users. The nonprofit advertising partner also controls targeting of the campaigns, and can match 
messaging to target audiences 


Inclusion in the Covid Information Center: Similar to what we did with vaccines.gov (as well 
as 1-800 number in English and Spanish}, we could add covidtests.gov and 1-800-232-0233 to the Covid 
Information Center as an evergreen resource for users. 


We want to make sure we're in lockstep with your teams, particularly to ensure that we're effective in our efforts 
to slow the spread of Covid. If you have any questions about these options, I'm happy to set up time with our 
teams to provide additional details, 
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From: GE <0 = THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Rowe, Courtney M. EOP/WHO; HE 2 h0.cop.gov, Manning, Tim W. EOP/WHO 
cc: Flaherty, Rob R. EOP/WHO; Waldo, Eric (HHS/OASH); © hhs.gov 

Sent: 5/3/2022 12:51:57 PM 

Subject: Cowid Insights report 

Attachments: 4.15 22 - COVID-19 Insights.pdf; 4_29 22 - COVID-19 Insights.pdf 


Attaching the past two reports for your review. These cover the periods from 3/20 through 4/16. Also flagging that 
it would help to hear from you if these reports continue to provide useful context or if you'd like to follow up witha 
discussion as to how we can be helpful during ‘his phase of the pandemic. We filed a response to the Surgeon 
General's rfi on Covid misinformation and woud be happy to discuss at the appropriate time. 


Thanks, 
34 
From: Ob com> 


Date: Monday, April 4, 2022 at 2.48 PM in 
@who.eop.gov>, 


To: Rowe, Courtney M. EOP/AWHO < { 
who.éop.gov < @who.eop.gov>, Manning, Tim W. EOP/WHO 
@who.eop.gov> 2 


Ce: Flaherty, Rob R. EOP/WHO who.eop.gov>, Waldo, Eric (HHS/OASH) 
EEGs cov 


hhs.gov> 
Subject: Re: Covid Insig 


Attached is the most recent Insights report. Teplines are below as well. 


Given the shifting dynamics of the pandemic, it would help to understand if these reports are still useful or if we 
should rethink the cadence of our sending this information. Any objections to scaling back to a monthly report? If 
folks find the biweekly cadence useful we are happy to keep it up, just want to be responsive to your interests. 


Thanks—and please let me know if you have any other feecback that we should consider. 


Below is what we are seeing in the top 100 most viewed overall posts on Facebook in the US, as well as the top 
vaccine related posts on Facebook in the US for the weeks of 03/06/22 - 03/12/22 and 03/13/22 - 03/19/22. 


As before, this report is focused on top vaccine related posts only. We're continuing to investigate and build 
analysis around content that isn’t captured in ths report. Again, the analysis provided below may be subject to 
other methodological challenges or errors - e.¢., the specific rank number may not be exact. 


1. Top 100 overall posts on FB in the U.S. 
When looking at the overall top 100 posts viewed on Facebook in the United States during the week of 03/06/22 - 
03/12/22, we see 0 pieces of content were specifically related to vaccine content. 


When looking at the overall top 100 posts viewed on Facebook in the United States during the week of 03/13/22 - 
03/19/22, we see that 0 pieces of content were specifically related to vaccine content. 


Top 100 vaccine-related posts on FB in the U.S. 
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Of the Top 100 vaccine-related posts viewed cn Facebook in the United States during the week of 03/06/22 - 
03/12/22: 


1. Opests were deleted for violating our COVID-19 and vaccine policies. 

2. O posts were labeled labeled by third-party fact-checkers for “missing context”. 

3. O posts were labeled and demoted upon review. 
Of the Top 180 vaccine-related posts viewed cn Facebook in the United States during the week of 03/13/22 - 
03/19/22: 


1. O posts were deleted for violating our COVID-19 and vaccine policies 

2. Oposts were labeled anc demoted by third-party fact checkers 

3. 1 post was labeled and demoted for sensationalist content about the number of vaccine doses that will be 
recommended in future. 


From: i o1>.com> 


Date: Monday, March 28, 2022 at 2:26 PM 
To: Rowe, Courtney M. EOP/WHO < who.eop.gov>, 


@who.eop.gov who.eop.gov>, Manning, Tim W. EOP/WHO 
@who.eop.gov> 7 


Ce: Flaherty, Rob R. EOP/WHO - -gov>, Waldo, Eric (HHS/OASH) 
SEE ins cov>, Bohn. gov 
Subject: Re: Covid Insights report - 


Sending the latest version of our insights report. Please let me know if you have any questions. 


OOMeta 
US Public Policy 


meneaar D.C. 20004 


ee 
Date: Wednesday, February 23,2022 at 3:32 PM 
who.eop.gov>, 


To: Rowe, Courtney M. EOP/WHO 

ey —————— Manning, Tim W. EOP/AWHO 
@who.eop.gov> 

Ce: Flaherty, Rob R. EOP/WHO who.eop.gov>, Waldo, Eric (HHS/OASH) 

GEE his. o>, @hhs.gov hhs.gov> 


Subject: Covid Insights report - 


Sending the latest Covid Insights Report—please let us know if you have any questions. 


Thanks and have a good week. 


| OOMeta 
US Public Policy 


Se D.C. 20004 
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From: aS </0- THEFACEBOOK/OU=EXTERNAL (FYDIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob R. EOP/WHO; Manning, Tim W. EOP/WHO; Salcido, Dori A. EOP/WHO; Cheema, 
Subhan N. EOP/WHO 

ce: Waldo, Eric (HKS/OASH); EEE bs. gov 

Sent: 6/13/2022 8:25:24 PM 

Subject: Re: Covid Insights report 


Thanks Rob—appreciate the feedback. Will circle up with the team and get you an update, and will keep the 
reports gomy as long as they re providing value. 


Get Outlook for 10S 


From: Flaherty, Rob R. EOP/WHO EE 10.200. gov> 
Sent: Monday, June 13, 2022 6:11:16 PM 


To: fb.com>; Manning, Tim W. EOP/WHO <{@ who.cop.gov>; Salcido, 
Dori A. EOP/WHO < who.eop.gov>; Cheema, Subhan N. EOP/WHO 


< @who.eop.gov> 


Ce: Waldo, Eric (HHS/OASH) ois gov>; [EES hhs.cov <§Morhs.cov> 


Subject: RE: Covid Insights report 


Hey ML Thanks for these. | would normally say we are good to discontinue but it would be helpful to continue 
to get these as we start to ramp up under 5 vaccines. Obviously, that has a potential to be just as charged. Would 
love to get a sense of what you all are planning here. I’m also adding in Dori and Subhan who have replaced 
Courtney and Ben. 


From: fb.com> 
Sent: Monday, June 13, 2022 3:27 PM 


To: Rowe, Courtney M. EOPAVWHO EE 2 .0.cop.gov>. VWakana, — L. EOP/AWHO 


EE 3. e0p.gov>; Manning, Tim W. EOP/WHO < who.eop.gov> 
Ce: Flaherty, Rob R. EOP/WHO who.eop.gov>; Waldo, Eric (HHS/OASH) 
<—ER@ hhs.gov>; hhs.gov 


Subject: [EXTERNAL] Re. Covid Insights report 


Hi all, 


Attaching recent reports for your review. Ve will plan to discontinue these unless we hear from you that this 
information continues to be valuable. We're happy to continue, or to pick up at a later date, if circumstances 
warrant or if we hear from you that this continues to be of value. Providing a summary below from our team 
detailing the decrease in vaccine related posts we have seen over the past 6 months for further context. 


Thanks and please let me know if you have any questions. 


Over the last 6 months, there has been a noticeable decrease in top vaccine-related posts that were demoted as 
misinformation or for sharing misleading or sersationalized information about vaccines in a way that would be 
likely to discourage vaccinations. There has not been a post misinforming or discouraging vaccination in this way 
in the top 100 vaccine-related posts since the week of February 27th, 2022, and the overall trend peak dates back 
to October of 2021. The total number of posts removed for violating our COVID-19 or vaccime misinformation 
policies has remained at | since the week of December 13th, 2021. We believe this trend will continue given the 
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sustained low volumes of top-vaccine related posts despite the Omicron variant surge experienced in early 2022. 


We recommend discontinuing this report as we are no longer seeing problematic vaccine related posts (Borderline 
Vaccine) in the top 100 posts viewed on FB in the US, Deprecation of this report will not impact existing 
enforcement measures or ongoing monitoring and reporting on the problem. Meta will continue to reduce the 
prevalence of this problem, and will reinstate the reports if events warrant. 


From: fb.com> 
Date: Tuesday, May 3, 2022 at 3:51 PM 
To: Rowe, Courtney M. EOP/WHO < @who.eop.gov>, 


penjamin.|.wakana@who.eop.gov ee Manning, Tim W. EOP/WHO 
< @who.eop.gov> 


Cc: Flaherty, 
< 


Rob R. EOP/WHO < who.eop.gov>, Waldo, Eric (HHS/OASH) 
GE hhs.gov>, @hhs.gov SEE} 7s.0v> 


Subject: Covid Insights report 


Attaching the past two reports for your review. These cover the periods from 3/20 through 4/16. Also flagging that 
it would help to hear from you if these reports continue to provide useful context or if you'd like to follow up with a 
discussion as to how we can be helpful during ‘his phase of the pandemic. We filed a response to the Surgeon 
Generals rfi om Covid misinformation and woud be happy to discuss at the appropriate time. 


Thanks, 


From: Dib.com> 
Date: Monday, April 4, 2022 at 2.48 PM 


To; Rowe, Courtney M. EOP/WHO < who.eop.gov>, 
. who.eop.gov>, Manning, Tim W. EOP/WHO 


< wWho.e0p.gov> 


Ce: Flaherty, Rob R. EOP/WHO 
SEBO 1s go>, 


Subject: Re: Covid Insights report - 


who.eop.gov>, Waldo, Eric (HHS/OASH) 


@hhs.gov <fMOhhs.gov> 


Attached is the most recent Insights report. Tcplines are below as well. 


Given the shifting dynamics of the pandemic, it would help to understand if these reports are still useful or if we 
should rethink the cadence of our sending this information. Any objections to scaling back to a monthly report? If 
folks find the biweekly cadence useful we are happy to keep it up, just want fo be responsive fo your interests. 


Thanks—and please let me know if you have any other feecback that we should consider. 


Below is what we are seeing in the top 106 most viewed overall posts on Facebook in the US, as well as the top 
vaccine related posts on Facebook in the US for the weeks of 03/06/22 - 03/12/22 and 03/13/22 - 03/19/22. 


As before, this report is focused on top vaccine related posts only. We're continuing to investigate and build 
analysis around content that isn’t captured in this report. Again, the analysis provided below may be subject to 
other methodological challenges or errors - e.¢., the specific rank number may not be exact. 


1. Top 100 overall posts on FB in the U.S. 
When looking at the overall top 100 posts viewed on Facebook In the United States during the week of 03/06/22 - 
03/12/22, we see 0 pieces of content were specifically related to vaccine contert. 
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When lcoking at the overall top 100 posts viewed on Facebook in the United States during the week of 03/13/22 - 
03/19/22, we see that 0 pieces of content were specifically related to vaccine content. 


Top 100 vaccine-related posts on FB in the U.S. 
Of the Top 100 vaccine-related posts viewed cn Facebook in the United States durina the week of 03/06/22 - 
03/12/22: 


1. O posts were deleted for violating our COVID-19 and vaccine policies. 

2. O posts were labeled labeled by third-party fact-checkers for “missing context”. 

3. Oposts were labeled and demoted upon review. 
Of the Top 100 vaccine-related posts viewed cn Facebook in the United States during the week of 03/13/22 - 
03/19/22: 


1. Opests were deleted for violating our COVID-19 and vaccine policies 

2. O posts were labeled and demoted by third-party fact checkers 

3. 1 post was labeled and demoted for sensationalist content about the number of vaccine doses that will be 
recommended in future. 


From: fb.com> 
Date: Monday, March 28, 2022 at 2:26 PM 
To: Rowe, Courtney M. EOP/WHO who.eop.gov>, 


enjamin.|.wakana@who.eop.gov < who.eop.gov>, Manning, Tim W. EOP/WHO 
@who.eop.gov> 


. 
Ce: Flaherty, Rob R. EOP/WHO <i who.eop.gov>, Waldo, Eric (HHS/OASH) 
hhs.gov>, on hs.gov (MMO hhs.gov> 


Subject: Re: Covid Insights report - 


Sending the latest version of our insights report. Please let me know if you have any questions. 


| OOMeta 
US Public Policy 


aes D.C. 20004 
From: iE O{b.com> 


Date: Wednesday, February 23, 2022 at 3:32 PM 


To: Rowe, Courtney M. EOP/WHO < who.eop.gov>, 
ain who.eop.gov>, Manning, Tim W. EOP/WHO 


< @who.eop.gov> 
Cc: Flaherty, Rob R. EOP/WHO <M Owho.cop.gov>, Waldo, Eric (HHS/OASH) 
hhs.gov>, MH @hhs.gov < hhs.gov> 


Subject: Covid Insights report - 


Sending the latest Covid Insights Report—please let us know if you have any questions. 


Thanks and have a good week. 


—r, OO Meta 
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From: GE <0 =THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=7C6251C0920BB487E8111461E3692A624> 

To: Flaherty, Rob R. EOP/WHO; Manning, Tim W. EOP/WHO; Salcido, Dori A. EOP/WHO; Cheema, 
Subhan N. EOP/WHO 


Cc: Waldo, Eric (HKS/OASH); EE his. gov 


Sent: 7/17/2022 8:16:55 PM 

Subject: Re: Covid Insights report 

Attachments: 6 24 22 - COVID-19 Insights.pdf; 07_O08_22 - COVID-19 Insights. pdf 
Reb et all, 


Including the most recent two reports here for your review. VVe'll have the next version ready for this Friday. 
Please let me know if you have any questions. 


From: Flaherty, Rob R. EOP/WHO EE 6 110.200. gov> 7 


Date: Monday, June 13, 2022 at 6:11 PM 
To: fb.com>, Manning, Tim W. EOP/WHO =... - 
who.eop.gov>, Saicido, Dori A. EOP/WHO EE Own o.cop.gov>, 
Cheema, Subhan N. EOP/WHO : who.eop.gov> 
Ce: Waldo, Eric (HHS/OASH) hhs.gov>, onns.gov 
(EEE Obs co SR: 
Subject: RE: Covid Insights report 


Hey ol Thanks for these. | would normally say we are. good to discontinue but it would be helpful to continue 
to ge se as we Start to ramp up under 5 vaccines. Obviously, that has a potential to be just as charged. Would 
love to get a sense of what you all are planning here: I’m also adding in Dori and Subhan who have replaced 
Courtney and Ben. De 


From: RG fb.com> 


Sent: Monday, June 13, 2022 3:27 PM... 
To: Rowe, Courtney M. EOP/WHO < (EO who.cop.gov>; Wakana, Benjamin L. EOP/WHO 
who.eop.gov>; Manning, Tim W. EOP/WHO < who.eop.gov> 


Cc: Flaherty, Rob R. EOPAWHO who.eop.gov>; Waldo, Eric (HHS/OASH) 
SEE © hs. c0v>: INO Ms 30 


Subject: [EXTERNAL] Re: Covid Insights report 


Hi all, 


Attaching recent reports for your review. We will plan to discontinue these unless we hear from you that this 
information continues to be valuable. We're happy to continue, or to pick up at a later date, if circumstances 
warrant or if we hear from you that this continues to be of value. Providing a summary below from our team 
detailing the decrease in vaccine related posts we have seen over the past 6 months for further context. 


Thanks and please let me know if you have any questions. 


Over the last 6 months, there has been a noticeable decrease in top vaccine-related posts that were demoted as 
misinformation or for sharing misleading or sersationalized information about vaccines in a way that would be 
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likely to discourage vaccinations. There has not been a post mismforming or discouraging vaccination in thts way 
in the top 100 vaccine-related posts since the week of February 27th, 2022, and the overall trend peak dates back 
to October of 2021. The total number of posts removed for violating our COYID-19 or vaccine misinformation 
policies has remained at 1 since the week of December 13th, 2021. We believe this trend will continue given the 
sustained low volumes of top-vaccine related posts despite the Omicron variant surge experienced in early 2022. 


We recommend discontinuing this report as we are no longer seeing problematic vaccine related posts (Borderline 
Vaccine) in the top [06 posts viewed on FB in the US. Deprecation of this report will not impact existing 
enforcement measures or ongoing monitoring and reporting on the problem. Meta will continue to reduce the 
prevalence of this problem, and will reinstate the reports if events warrant. 


From: fb.com> 
Date: Tuesday, May 3, 2022 at 3:51 PM 


< 


who.eop.gov>, 
who.eop.gov>, Manning, Tim W. EOP/WHO 


@who.eop.gov> 


Cc: Flaherty, Rob R. EOP/WHO < who.eop.gov>, Waldo, Eric (HHS/OASH) 
aes 


@hhs.gov (Oh hs.gov> 
Subject: Covid Insights report eee 


Attaching the past two reports for your review. These cover the periods from 3/20 through 4/16. Also flagging that 
it would help to hear from you if these reports continue to provide useful.context or if you'd like to follow up with a 
discussion as to how we can be helpful during ‘his phase of the pandemic. We filed a response to the Surgeon 
General's rfi on Covid misinformation and woud be happy to discuss at the appropriate time. 


Thanks, 


Date: Monday, April 4, 2022 at 2:48 PM. — 
To: Rowe, Courtney M. EOP/WHO s 


@who. eop.gov>, Manning, Tim W. EOP/AWHO 


who.eop.gov> 
Cc: Flaherty, Rob R. EOP/WHO 
hhs.gov>, 
Subject: Re: Covid Insights report - 


who.eop.gov>, Waldo, Eric (HHS/OASH) 


@hhs.gov <P Ch ns. gov- 


Attached is the most recent Insights report. Toplines are below as well. 


Given the shifting dynamics of the pandemic, it would help to understand if these reports are still useful or if we 
should rethink the cadence of our sending this information. Any objections to scaling back to a monthly report? If 
folks find the biweekly cacence useful we are rappy to keep it up, just want fo be responsive to your interests. 


Thanks—and please let me know if you have any other feedback that we should consider. 


Below is what we are seeing in the top 100 most viewed overall posts on Facebook in the US, as well as the top 
vaccine related posts on Facebook in the US for the weeks of 03/06/22 - 03/12/22 and 03/13/22 - 03/19/22. 


As before, this report is focused on top vaccine related posts only. We're continuing to investigate and build 
analysis around content that isn’t captured in this report. Again, the analysis provided below may be subject to 
other methodological challenges or errors - e.c., the specific rank number may not be exact. 
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1. Top 100 overall posts on FB in the U.S. 
When looking at the overall top 100 posts viewed on Facebook in the United States during the week of 03/06/22 - 
03/12/22, we see 0 pieces of content were specifically related to vaccine contert. 


When looking at the overall top 100 posts viewed on Facebook in the United States during the week of 03/13/22 - 
03/19/22, we see that 0 pieces of content were specifically related to vaccine content. 


Top 100 vaccine-related posts on FB in the U.S. 


Of the Top 100 vaccine-related posts viewed on Facebook in the United States during the week of 03/06/22 - 
03/12/22: 


1. O posts were deleted for violating our COVID-19 and vaccine policies. 

2. O posts were labeled labeled by third-party fact-checkers for “missing context”. 

3. O posts were labeled and demoted upon review. 
Of the Top 100 vaccine-related posts viewed cn Facebook in the United States during the week of 03/13/22 - 
03/19/22: 


1. O pests were deleted for violating our COVID-19 and vaccine policies 

2. O posts were labeled and demoted by third-party fact checkers ‘ 

3. 1 post was labeled and demoted for sensationalist content about ue number of vaccine doses that will be 
recommended in future. a 


From: @fb.com> 
Date: Monday, March 28, 2022 at 2:26 PM 
To: Rowe, Courtney M. EOP/AWHO < 


who.eop.gov>, 

who.eop.gov>, Manning, Tim W. EOP/WHO 
who.eop.gov> 
Cc: Flaherty, Rob R. EOP/WHO 
hhs.gov>, 
Subject: Re: Covid Insights report - an 


who.eop.gov>, Waldo, Eric (HHS/OASH) 
hhs.gov> 


pene deN 


Sending the latest version of our insights report. Please let me know if you have any questions. 


OO Meta 
US Public Polic 


as D.C. 20004 


From: fb.com> 
Date: Wednesday, February 23, 2022 at 3:32 PM 
To: Rowe, Courtney M. EOP/WHO 


who.eop.gov>, 
who.eop.gov>, Manning, Tim W. EOP/AWHO 


@who.eop.gov> 
Ce: Flaherty, Rob R. EOP/WHO 
hhs.gov>, 
Subject: Covid Insights report - 


who.eop.gov>, Waldo, Eric (HHS/OASH) 
hhs.gov> 


Sending the latest Covid Insights Report—pleese let us know if you have any questions. 
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Thanks and have a good week. 


| COMeta 
US Public Policy 


Washington, D.C. 20004 
——_—aaae 
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From: MR «= THEFACEBOOK/OU=EXTERNAL (FY DIBOHF25SPDLT)/CN=RECIPIENTS 
/CN=70251C0920BB487E8111461E3692A624> 


To: Flaherty, Rob R. EOP/WHO; Manning, Tim W. EOP/WHO; Salcido, Dori A. EOP/WHO; Cheema, 
Subhan N. EOP/WHO 

ce: GE 3S /08S}); EE os. cov, 

Sent: 6/22/2022 7:56:43 AM 

Subject: Policy changes for under 5 vaccines 


Rob and Team, 


Wanted to ensure you were aware of our policy updates following the early childhood vaccine approvals. As of 
today, all COVID-19 vaccine related misinformation and harm policies on Facebook and Instagram apply to people 
6 months or older {with the exception of the claim that the COVID vaccines have full FDA approval since children 


nave only emergency use authorization}. 


We expanded these policies in coordination with the CDC and ensured that we also included false claims that 
might be comnected to children, such as the false claim that COV'D vaccines cause Multisystem inflammatory 


syndrome in children (MIS-C). 


If you have further questions or would like a briefing, please let me know. 


Best, 
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Event Memo - YouTube Town Hall 


As of 12/10/2020 Y) 
DRAFT - EVENT MEMO 9) 

FROM: Rob Flaherty, Digital Director, © 
Medha Raj, Deputy Digital Director, Y) 
Olivia Raisner, Traveling Digital Director, 

SUBJECT: YouTube Town Hall 

EVENT DATE: Wednesday, December 16, 2020 

TIME: 4:45PM - 5:30PM (Arrival Time: 4:30PM) 

LOCATION: Zoom (Link to be provided before event) 

ATTIRE: Business casual ° 

VERSION: Current as of Thursday, December TOn2d20 


The President Elect, three health appointee several well-known 

YouTube creators will engage in a 45-minute, erated Zoom 

conversation about COVID. The PE will brief remarks, after which the 
é : 


panel will take questions from the YouT reators. Potential topics 
include: vaccine dissemination, onde ety, and the economic impacts of 


COVID. 
bee 


The purpose of this event i Spillet both our message, and 
high-quality health informati ut COVID through new Digital channels. 
In this way, we'll reach impextant constituencies who we do not reach 
through traditional channels. This conversation also provides the 
opportunity to introduce appointees to the public and instill confidence in 
the incoming admipt ion’s leadership. 

® 
This video wie eleased on BFP and Transition social media platforms, 
as well as as ouTube creators’ platforms. This is not a live event. 


|. PURPOSE Ne 
> 
® 


O 1 of 3 
S 
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Event Memo - YouTube Town Hall 
As of 12/10/2020 


lll. PARTICIPANTS 


Biden-Harris Transition participants: © 
e President Elect WO 
e Dr. Vivek Murthy, Surgeon General (appointee) Y 

e Dr. Marcella Nunez-Smith, COVID-19 Equity Task Forc 

(appointee) Se 
e Dr. Rochelle Walensky, CDC Director (appointee) 
AS) 

Discussions are ongoing with YouTube creators. We vu Provide an 
updated list of participants as soon as possible. SO 


IV. PRESS PLAN » 
g 


This event will be CLOSED press. 


NN 
V. CE OF EVENT O 
4:45 pm one hae the event and participants. 
4:48 pm Presid ect says hello to participants and makes 
br ing remarks (scripted). 
4:53 pm derator tells YT Creator to ask question #1. 


in and/or relevant health panelist responds. 


5:00 pm © PF voderator tells YT Creator to ask question #2. 
La PE and/or relevant health panelist responds. 


5:07 “oy Moderator tells YT Creator to ask question #3. 
C PE and/or relevant health panelist responds. 
* 


Sad pm Moderator tells YT Creator to ask question #4. 
.& PE and/or relevant health panelist responds. 


cP 
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Event Memo - YouTube Town Hall 


As of 12/10/2020 Y) 


5:21 pm Moderator thanks creators and appointees for thei 
time and turns to the PE to close the event. 


PE makes brief closing remarks, thanks > 
everyone for their time, and signs "Qe 
5:30 pm Event concludes. 
AS 
T ~ 


Final questions will be selected in the coming topo ahead of 


the event. Q 


go 


x 


a 


3 of 3 
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Message 
From: SES GEE © :00¢!¢.com) 5, 


Sent: 1/29/2021 7:35:29 AM 9) 
To! SE GEE © c00212.com) 
Subject: Re: YouTube Civics / ODS Team Meeting 1 


Great note, thanks for sharing. Thorough recommendations in an easy to digest format. Glad y ged them 
on publishing their made for digital formats. Gy” 


On Thu, Jan 28, 2021 at 9:01 AM a SR Oc oogle.com> wrote: 


Email to ODS following our meeting - figured I would spare your inbox and give you tes during 1:1s and 
over ping as we get into the weeds 


® 
wii Forwarded message --------- O 
From: I SI © 200zlc.com> > 


Date: Thu, Jan 28, 2021 at 8:59 AM 

Subject: YouTube Civics / ODS Team Meeting 1 

To: Flaherty, Robert EOP/WHO ristian L. EOP/WHO 
@who.eop.gov>, Cohen, Brendan W. EOP/W eop.gov>, 


Qureshi, Hoor EOP/WHO @who.eop.gov>, 
@who.eop.gov> 
ee LLs—siSY @google.com>, <Q @ coogle.com> 


@who.eop.gov>, T: 


Hi Rob, Christian, Jonathan, Rebecca, Brendan, andgHo O 


> 


to supporting your work bringing the Presiden ig team's messages to life on YouTube. You'll find items 


Great to convene with you as you kick-off the Biden Ad®inistration's digital strategy! We are looking forward 
t 
per topic below: 


Channel Transition 


° Channel Access: Individual team fmbers below should create Google Accounts with your .gov emails 
using this link and email us when done yi we can add you as Managers to the Channel. 


° Rob 

° Jonathan he 

° Rebecca Oy 

° Hoor S 

Initial Key Audience {ee shopment Recommendations 

° Streams: C ePmoving ASL picture out of picture-in-picture to right-hand side like 


campaign fort Goi a closer-up thumbnail of Jen. Titles look great, consider adding a location tag, and 
a 2-3 c~<= escription for each stream to help with SEO. 


structions 
SE s/VODs: Consider scheduling the "Jen Psaki Answers Twitter Questions" upload to this 
we fter M-F Press Sec briefings) as a complementary made for digital video for the Press Briefing 


CY audience. 
° Best Practices 
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° Instructions 


° Embeds: Consider embedding your live streams to YouTube on a landing page like wh.gov/live that 
automatically pulls in your latest feed and has a prompt to subscribe on YT underneath to help with Goo 
SEO. 


° +Santos Flores de Leon can help your tech team with setup if helpful 


° Instructions Y 
» Stories: Consider uploading your images for social and the "Dr. Fauci Wear A Mask Vide®y short 
d 


vertical video to the Stories placement given its discovery power by new audiences. Uploa Sfories will 
grow your audience like during campaign given the prominent subscribe button overl romo of 
stories on the YouTube Home page. 


° Best Practices 


° Instructions ‘ ( ) 
* [Beta] Shorts: Consider also uploading the "Dr. Fauci Wear A Mask tN a regular vertical video 


upload (not a Stories upload). This qualifies for our YouTube Shorts beta e nt since it is under 60 
seconds. PIC saw great traffic from this beta as we continue to evolve it. 

° YouTube Shorts Announcement ~) 

° Instructions 

® The above activations should get you to 2M subscribers in W€ short-run, and I would recommend setting 


a goal of reaching 3M subscribers on a time horizon that =? or you. 


Initial Key Creator Engagement Ideas (Ordered By Priorit 
e COVID-19 Relief Package: 


° Format: Spokespeople Interviews w/ essive Political Commentators 

° Creators: Brian Tyler Cohen, Inegualit dia, Crooked Media, Roland Martin, David Pakman, 
The Young Turks (TYT), The Damage Report Secular Talk (TYT), The Majority Report w/ Sam 
Seder. 


° Al: Let me know if you are f in connections. 


° Vaccine Creator Town Hall + Recovery + Climate + Racial Justice 

° Format: Similar to Transition Creator Town Hall Idea in Attachment | 

° Representative C eator#nitially Vetted: Jackie Aina, Manny Mua, Brave Wilderness, Tyler 
Oakley ‘\ 

° Al: Let me,kn u would like me to reconnect you to the four threads with each Creator 
that J and I started u er you are ready to do so if interested. We'll want to give Creators 2 - 3 
weeks of runway for scale 


° Cabinet Appoifte@interviews w/ Creators 
Sduced in Zoom, edited in Creator's format of choice 


nterested: In Attachment 2. 


format -‘Yhe first format in the brief. I really like the second format given it is similar to what you did on the 
call (FaceTime surprise). 
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video team shoot, there may be some flexibility beyond that date before they edit. I imagine a remote shoot 
your video team generally makes the most sense. os) 


° Al: If there is interest, just let me know and will connect you to the YouTube Originals Team OQ 


° Note: The YouTube Originals Team is aiming to shoot next week by 2/5, but if it is easier for your @) 


logistics/further questions you may have. 


Joint Session of Congress %) 
° We are hoping to have a similar promotion experience to the Inauguration for your sieahagh e 
President's joint address to Congress. 


° AI: Let us know when you lock down a date so we can book a promo shelf for oe Home page 


across devices. 


Next Syncs 

° Tech Meeting: Let us know if you would like [J to help your tech,teajh setyip automated analytics 
given your workflow. Here are the two free resources he introduced: Y 

° YouTube Analytics and Reporting APIs 

° Google Cloud BigQuery Data Transfer Service (More Ad Flexible) 

e Content Strategy/Analytics Meeting: Let us know of a | hr. sages well for this group the 
week of 2/8 so we can present a bespoke deck on: 

° Historical Obama and Trump White House conten cesses 

° Current YouTube content trends to consider to ,tnovate further 


Connecting With Us 
° Email: cc'd is the full team to email with any gest ‘Il generally answer, but J and Ij will 
jump in too as subject matter experts. 


* Phone: I can be reached 7 days a week a and will save #s as you reach out. 


Here to help, 


Addendum: +Tom, Christian L. EOP/ is a YouTube Studio link to the last 7 days comparison data 
between 2020 and 2017. We can cover hoWato navigate YouTube Studio Analytics in a future sync, but I also 
attached a screenshot of my view if ai initially. 


trategic Partner Manager, Civics 
Explore the United States of YouTube 


RS 


o> 


© 
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Zoom invitation for meeting between 
YouTube and the White House 


Appointment Zz 


From: Google Calendar [calendar-notification@google.com] ~ 
Sent: 2/3/2021 11:24:45 PM 
To: Flaherty, Robert EOP/WHO I @ who.eop.gov] 


Attachments: invite.ics 


Subject: Google <> ODS WO 


Location: Y) 
Start: 2/4/2021 8:00:00 PM 
End: 2/4/2021 9:00:00 PM 


Show Time As: Tentative 


Recurrence: (none) SS 


7=eEEeree) has accented this invitation. 
DS 


Thu Feb 4, 2021 3pm —4pm E¢ tOFFS Time « New 


+ BRR @o00gle.com XK 


- ER @000¢!e.com ‘e) 
- BR Qc009!e.co 

« Wakana, Benjamin L. EO 10) 

« Humphrey, Clarke EOPAVHO 

« Rowe, Courtney M. EOPAVHO 


Hi there, 
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Passcode: 


ri i 
ge 
Oy 


Join by Telephone © 


For higher quality, dial a number based on your current location. SO 


Dial: 


Meeting ID: O 
= 4] x 
Passcode: oO 


International numbers ? 


Join from an H.323/SIP room C 
H.323: 


S 


Pay: 
= 
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SIP: oO 
Gs 2. Z00™mgGov.com 


Passcode: 


invitation from Google Calendar 


3 this oct 


iesv email at the account robert llaherty@who_ eop.gay 


iture undates for this event, decline this event, Allern ; : 
aiendar googie con/caiendar and ceniral your notificaiion settings for your ent 


Forwarding this invitation could alow any recipient to serid a response to the 
regardiess of fel own invitation status, of to modify your RSVP. Learn Mag 


snizer and be addad te the quest list, of invite offers 
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Message 
From: GE © coogle.com) 5 


Sent: 3/9/2021 1:40:02 AM 
To: SEE GEE © 00¢1¢ com] 
[& Op @google.com] 


Subject: 


eee eee Oy 
Re: [EXTERNAL] Re: Mr. Beast g 
Hi ny 


Here's the short list in order of preference -- this one was a hard one. 


Note:: none of these creators have been vetted, so we're not sure who would be integgsted. 


@ 
Have a look through and let's ping tomorrow, 


- \ 
SS 


On Mon, Mar 8, 2021 at 12:50 PM .com> wrote: 
Sounds great, yy! 
On Mon, Mar 8, 2021 at 12:09 PM aaa @g00 > wrote: 


Working on it -- will have it over to you by end of d 


On Mon, Mar 8, 2021 at 11:55 AM a < ruxton@google.com> wrote: 


Hi x 


Hope you had a wonderful weekend - O 


Just want to check-in on the Presiderpghis k. Let me know if you need any further revisions from me as 
you socialize. 


Looking forward to it, y 


trategic Partner Manager, Civics 


be 
® Channel Best Practices Guide 
Le 2021 Product Roadmap 
aera) 


& Goagis DC & LA 


716 


HJC-GOOG-00059642 


On Mon, Mar 1, 2021 at 11:13 AM © coo gle.com> wrote: 


Sounds great! 


G 
Thanks I. oy? 


On Mon, Mar 1, 2021 at 11:12 AM i <E @g0021e.com> wrote: Y) 
Hi. Bas 


Very helpful -- we want to build our nomination list right now, so we're going to h pine anything 
out to creators until we have yours and the WHs sign-off on potentials. 


Will get back to you over the next couple of days, 


a RS 


P.S -- Sorry I'm behind a day as I was unexpectedly 000 on Friday.. 


On Fri, Feb 26, 2021 at 12:48 PM ams mn? wrote: 
Hey 


Happy Fri! 


rt Schumer and Doctor Mike. It is 
ALS8OKSbTCe3NLpj3C43dPs8fsa4ds0/edit 


I put together a similar brief for SPMs like we did for 
here: https://docs.google.com/document/d/1eU9 


Do modify my language and let me know whe 
SPMs. Brandon, likewise. 


think it is in good form to share with Top Creator 


Thank you, thank you, thank you - to ey voit 


N ae Pariner Manager, Civics 
Explore the United States of YouTube 
Go 
KS Channel Best Practices Guide 


2021 Product Roadmap 


Googie DC & LA 


eb 25, 2021 at 10:32 AM a SS © coogle.com> wrote: 


$ to your Qs from Rob @ White House! 


_ } Date: Thu, Feb 25, 2021 at 10:28 AM 


Q ------ Forwarded message --------- 
C) om: Flaherty, Robert EOP/WHO + @ who.cop.gov> 
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Yeah, I think the primary audiences we’re trying to target around hesitancy are latino, black © 
conservative audiences, but I think for this we’re looking for something general market may Xe) 


speak to those audiences. 


Subject: RE: [EXTERNAL] Re: Mr. Beast Q) 


Timing, I think we’re thinking late March through Early May. I think the thing h Reipiore starting 
to try to build demand and correct hesitancy as availability starts to scale up. 


Certainly fine if the creator gets vaxxed in the video as long as, as you suggest, theYeare eligible and not 


seen as cutting the line. 
® sC ) 


Definitely with Biden and can be at the White House. Other option is eg: we could see about 
having them fly on AF1. Only thing with POTUS will likely be sagi cing, but theres ways to 
work around it. 


We’re open to a lot here ~) 


From: @google.com> 
Sent: Thursday, February 25, 2021 1:00 PM 
To: Flaherty, Robert EOP/WHO Zov> 
Ce: @google.cor 
Subject: Re: [EXTERNAL] Re: Mr. Beast 


Hey Rob, xX 


A couple of initial questions as vy our list of Top Creators to potentially engage: 


. Target Audience Requirefignts?: Age range? Gender? Demographics? Thinking about your 
focus on folks who are hesitant set the vaccine. 


° Timing?: April?«¢May? June? July? Later? Relates to who age-qualifies to receive at a given 
time. 


. Can Creatgr eRpecine in Video?: Assuming Creator meets general qualifications of course. 
This will help bui tic e trust. 


° Locationzs itely in-person with President Biden at The White House? Imagine this will be 
a requirement fek a + Sub Creator. 


Let us Kony ave any other parameters! We'll pause until we get your next thoughts here. 


ae 
> 
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Strategic Partner Manager, Civics 
Explore the United States of YouTube 


Civics Best Practices Resources oe) 
2021 Product Roadmap Oy 


SOOtHe & bE 


On Wed, Feb 24, 2021 at 3:01 PM aaa @Z00 a 


This is great and super helpful. bn 


to see if he has any creative ideas / Top Crea a) we may be missing for a 
moonshot beyond the list and existing programming idea. ~~) 


Give us a bit of time to chat, love the thoughts here, Q 


“Oo 


o 


Strategic Partner Manager, Civics 
Explore the United States of Hh al 
Civics Best Practices Resource 

2021 Product Roadmap 


a 
Google DC &LA oN 
On Oe 2021 at 2:49 PM Flaherty, Robert EOP/WHO <q who.cop.gov> 


oe Ww, 
att S Neer ais itself is that we'd have Mr. Beast at the White House and then have him and the 


nt pretend to be clinic volunteers calling people to remind them of their COVID 
ointments. Could work something out where Mr. Beast calls first and then hands off to his 
Ov 


( } Here’s what Ill say, and thanks for reupping the list. We are currently on the hunt for the thing is 
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going to be the “Between Two Ferns” of vaccination, so something that’s a grand slam moonshot th 


reaches a ton of people. I think the answer is probably with one of your endemics, but I think we’re 4) 


thinking like, someone in the Cocomelon/Mr. Beast/Dude Perfect/ tier. 


4 


Anyway, we obviously will continue to work with you on the broader program, but I think iffo 
got any ideas for the “massive engagement that goes down in history” tier, let me know. Q) 


From: 


To: Flaherty, Robert EOP/WHO @who.eop.gov> 


Subject: [EXTERNAL] Re: Mr. Beast 


Hey Rob, ied 


~ 


os 


@google.com> Y) 
Sent: Wednesday, February 24, 2021 5:30 PM 


Unfortunately Mr. Beast very respectfully declined himself. If yot are | iper keen on it, we can 


certainly pass along any details you'd like to provide and come y f that changes. 


You are probably thinking something up that is very Mr-“Qgast specific, but we do have that list of 
Creators who expressed interest in working with you fio icked off during the transition and 
il 


elevated again once we reconvened with you and the 
reattached it here. Let me know if others make © 


Always happy to help with ideas like t t eventually work out! 


O 


¢ 


—_— 


Strategic PartnéR@liaMager, Civics 
Explore the United es of YouTube 
Mas Resources 


: (@; Wed, Feb 24, 2021 at 11:07 AM i (I @c00gle.com> wrote: 


HIGHLY CONFIDENTIAL 


720 


ODS team post-inauguration. | have 


HJC-GOOG-00059646 


Totally, let me get in touch. It has been great to see him engage in the social impact space the last 
couple of years. Y) 
On Wed, Feb 24, 2021 at 10:56 AM Flaherty, Robert EOP/WHO @who.e D 

wrote: 


We have an idea for a thing we could do with Mr. Beast. Would you be down to Gr be 


interested in working with us? 


Sent from my iPhone Y) 


You | 5865 Campus Center Drive | Playa Vista | California | 90094 


”: | ©: GB Qccogie.com SO 


res ®@ ( ) 
| Global Creator Engagement, Partnerships Enablement Y 


On mobile: 


Strategic Partner Manager, Civics 
YouTube DC & LA 


| Global Creator Engagement, Partnerships blement 
Campus Center Drive | Playa Vista lifornia “Salfornia,, 90094 90094 
I | @googie.com Oo 


On mobile: 


Strategic Partner Manager, Civics 
YouTube DC & LA 


® > p 
| Global Cregto agement, Partnerships Enablement 
Youygue. | 5865 Campus rive | Playa Vista | California | 830094 


721 


HIGHLY CONFIDENTIAL HJC-GOOG-00059647 


Exhibit 99 


Email correspondence between 
YouTube and the White House 


722 


Message 
From: SEE GEES © <00¢1¢.com] 5, 


Sent: 3/12/2021 6:34:49 PM 9) 

To: Tom, Christian L. EOP/WHO (gO who.eop.gov] 

ce Hebert, Jonathan P. EOP/WHO @who.eop.gov]; Flaherty, Rob EOP/WHO Oy 
who.eop.gov]; Cohen, Brendan W. EOP/WHO s fa) 


EOP/WHO [ @who.eop.gov]; Rinkevich, Rebecca H. EOP/WHO 
Heskett, Andrew M. EOP/WHO (BO who.eop.gov); Bravo, Eric EOP/WHO 
GE © who. eop.gov); Kaur, Rajan EOP/OVP (HO ovp.eop.gov]; Verma, Garima 
@who.eop.gov); i PE coogle.com] 


Subject: Re: [EXTERNAL] YouTube Civics Meeting 3 


Of course! Looking forward to it. C) 
@ 


Below, you will find the Dr. Walensky video promoted on the YouTube Hormone a part of our COVID-19 


vaccine efforts. Let me know if you would like us to swap future videos ne: ve new video content. 


i Bite 2209 . s oe e & 
Bsn be 
e wom, oe 1929 Cnaetan Penne Stesten SG Reena Fras, & Pree Rov ng oh Dan Anew Snel 3 A Ray hat coin tn By Bon 
pore Supmannaen, Ssarberg De, DoH aoa ” 
SA ves Secon Hoe wean + Symes eee ‘ 


Sour tee fe byen Aabavese Carine eR 8 VRESHS NORSSONS BEETS 


PAC WATENSRY gales THE CONVERSATION 8 er Se ee 


BB Mancow % wmsarsee Neomon tot dies Senmea! e B Lomee IRS § aaron Bote, S86 FOOD, 
BR cee wee SNE My nie Caer nts, ADS EAR 


Happy Friday, 


Strategic Pariner Manager, Civics 
lore the United States of YouTube 


Channel Best Practices Guide 
2021 Product Roadmap 


Se vot 


o 


» 
On Thu, Ma i at 7:36 AM Tom, Christian L. EOP/WHO 4 @ who.eop.gov> wrote: 


John t o much for these detailed follow-ups. 


‘ll the lead on working with the various teams on these action items. 
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For the “Help is Here Tour — YouTube Edition,” I’m going to start a separate thread to plan and operationath) 


that separately. 9) 
Thanks again! Oy 


-- Christian ~~ 


Sent: Thursday, March 11, 2021 9:05 AM 
To: Hebert, Jonathan P. EOP/WHO 


@who.ecop.gov>; Rinkevich, Rebecca H. EOP/WHO < ! .cop.gov>; 


<EEE ©who.cop.gov 
Heskett, Andrew M. EOP/WHO <q © who.cop.gov>; 


@who.eop.gzov> 


© ho.cop.gov. 
Ce: Kaur, Rajan EOP/OVP @Movp.eop.gov>; Verma, Gos 


Subject: [EXTERNAL] YouTube Civics Meeting 3 


Happy Wednesday WH team, < 


First, here is an infographic with YouTube's latest r@acl#stats compiled with ComScore: 


a (18+) wec-20) BESS 


or watches 59 mins of YouTube ser cay 


Ge Youtube YouTube reaches 88% of t 


FRE, PTR AES RE. 


he Roe 
34 Pi enia 
26-34 FD wan 
36-84 St ovis 

SS orsien 


tf BS-48 


% 
Second, kate ind a read-out of Christian and my discussion today below: 


Platforta Strategy Recommendations 
& Brendan W. EOP/WHO 
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WHCA stream titles have been especially long, which makes them not fully readable to YouTube viewers 
particularly on mobile. This decreases CTR, watchtime, and therefore broader distribution. Here are a) 
example videos with some recommended adjustments: fon 


1) Shorten Video Titles to 9 Keywords: 2) 


Existing: President Biden Hosts an Event with the CEOs of Johnson & Johnson and Merck Y) 
Recommended: President Biden Speaks with Johnson & Johnson and Merck CEOs N 


Existing: President Biden Participates in a Virtual Call to Congratulates the NASA tance Team 
Recommended: President Biden Congratulates the NASA Perseverance Team 


. 
Existing: President Biden Delivers Remarks to Workers © 


Recommended: President Biden On Workers’ Rights to Organize & Unionj e descriptive given news 
cycle) 


Great Existing Title: COVID-19 Relief Package Explained in 3 SS 
. Alternative A/B Test: President Biden's Stimulus Plan Expf@ged in 3 Minutes 


* Consider using Google Trends to see if "COVID-19 ef" keyword has more traffic than "American 
Rescue Plan" as you build out more content on this topic O ifferent phrases. 


2) Channel Featured Sections: & 

Add Featured Sections to your YouTube Ch age. ® recommended order is below: 
e Channel trailer (all set) ae 

« Upcoming live stream shelf (add, updat ically) 

« Uploads (all set, updates automatica 

e President Biden (add, using existing playlist) 

¢ Vice President Harris (add, using exjgting WHCA playlist) 

+ (Consider adding a First eS section) 


« Past live stream shelf (add, ox 
* 
3) Stories: 


Vertical video or =e new/younger audiences - great place to highlight other 


automatically) 


principals: Instructio 


Congrats on the ‘Oy e of uploads! 


4) Shorts 


Sub 60 Sa ren video to reach new/younger audiences - great place to highlight other 
princip ctions 


Con n the first upload! 


S 
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Video Production Recommendations 
+Hebert, Jonathan P. EOP/WHO @) 


1) Custom Thumbnail Templates: of 
Navy + bolder/larger r text overlay for Live Streams. WH logo in comer. Gold + bolder/larger tex 
VODs. WH logo in comer. Instructions (for WHCA). ws 


For the PressSec Q&A videos, a larger bolder Q&A keyword in the thumbnail should Zp. It is hard 
to read the text in the thumbnails at the moment. 


2) End Screens: 


Ideally includes existing navy WH end slate with call-to-action text above the Surge Card, Link Card 
(to whitehouse.gov), and Video/Playlist Cards. Best Practices & sie 


3) Uploads/VODs: Consider aiming for 5 - 7 minutes if you can for nor ua eemen like Jen's 
Q&As: Instructions 


4) Dr. Walensky Vaccine Q&A Home Page Promotion: ed in our COVID-19 Info w/ an 
Expert YouTube Home Feed Shelf in the next 48 hours. 


5) Horizontal Cut of Dr, Fauci J&J Vaccine Q&A ra to be able to do the same for this video, Can 
you upload a horizontal version? We can also doa eplace on the existing video. 


Joint Session Address 
+Tom, Christian L. EOP/ WHO 


. We aim to promote your feed of t dress in front of the national broadcasters in alphabetical order 
like the Inauguration on the YouTube Home*feed, 


° We also will promote a == version with Spanish national broadcasters, so consider 


creating a Spanish feed. 
> AI: Schedule the Englj panish Live Events in YouTube Live Control Room w/ Custom 
Thumbnails when the d 


Ee ized, and I'll finalize promo. 


Digital Help Is tek Pour 
HO 


terview format in Creator's style/length to best align with their audience. 


Leads List: \n order of creator activation ease: 
Cardona (Education): John Green 


« O 
a Barcera (HHS): Dr. Danielle Jones, Dr. Cedric Jamie Rutland 
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° Mayorkas (HomeSec): Penny Tovar, Alex Costa, Nabela Noor, Above The Noise 
° Yellen (Treasury): Bryce Hall, Two Cents Q) 


° Raimondo (Commerce): Two Cents, The Futur 9) 
re Kerry / EPA (Climate Envoy & EPA): SciShow, Penny Tovar, Brave Wilderness, Nabe: 
Connor Franta, It's Okay to be Smart, Josh Richards, Raven the Science Maven 

o Garland (Justice): Tarek Ali, Penny Tovar, Nabela Noor, Connor Franta, Ally Gy. & 
Julia Ensign, Sam Collins 

a Haaland (Interior): United States of YouTube list Y) 

0 Vilsack: United States of YouTube list 

° Pete (Transportation): United States of YouTube list 

o McDonough (VA): Vets list coming soon for you and F sea 


° Fudge (HUD); United States of YouTube list ~ 

. Al: Christian, can you put together a super quick brief for John unis Cardona? A 
framework can be found in the attached document. It is the Who-What- ere-Why framework if not 
immediately clear. Once we have that, we will set you up with John. ~~) 


Independent/Progressive Political Commentators Q 
e 


. Format: Spokespeople Interviews w/ independent/progr political commentators reaching news 
audiences that are less likely to watch cable news. 


° Leads List: Brian Tyler Cohen, Inequality Media, Craig Medi, Roland Martin, David Pakman, The 
Young Turks (TYT), The Damage Report (TYT), Sepiy’ T), The Majority Report w/ Sam Seder. 


. AI: A generic one page brief that I can sociale tp ea@#f you are interested in. 


Top Endemic Creator x POTUS Collabs\ 
+Flaherty, Robert EOP/WHO O 


In-Person Top Endemic Creator Col 


° Top Creator Team's Consideration List: Marques Brownlee, Lele Pons / Hannah Stocking (Work 
together alot), Rosanna Pansino, + Vagcine Creator Town Hall list (Below) 


. We could reach out to Mr.“Rgast again with greater detail about the in-person nature of this opportunity 


with a brief like John Green’ ould like to revisit him. J think it could be worth it if they hear directly 


from you with us. 
° The Try Guys wodaadyy also be interested since they were engaged on the Town Hall concept. 


Vaccine Creator toe 
. Format: Si o'Family Creator Town Hall 


Vetted: Jackie Aina (Black), Manny Mua (Latinx), Brave Wilderness (Rural), Tyler 


Oakley (L4@B 
° A Mas know if you would like me to reconnect you to the four threads with each Creator, Again, 
recogni Swnight transform into something else or be in some time. 


ni gjtiex me if you have any follow-up ideas/questions/thoughts! 
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Happy to help, 


2) 
oes . 0) 
Strategic Part ager, 
Civics 
[ Expiore n States of 


Practices Guide 


Exhibit 93 
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Exhibit 100 


Email correspondence between 
YouTube and the White House 
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Message 


From: TT SEEN? coosle.com) Y 
Sent: 4/15/2021 12:57:46 AM 9) 
To: SEE © :0021¢.com Qy 


cc fl coc! or) EY © coo: cor) 


GE @ coogie.com) Oh 


Subject: Re: Vaccine Misinfo 


SGTM 


On Wed, Apr 14, 2021 at 5:51 PM x I g00¢!e.com> wrote: 
Great, can we tentatively shoot for Wednesday between 1-2 pm EST? 
& Sf ) 


On Wed, Apr 14, 2021 at 8:07 wis @google.come Vv 
i'll make myself available whenever this works for{jj, Ij and the wh. 
aan XO 
Google Government Affairs and Public Policy ~~) 


Washington, DC 20001 


Android Mobil: {i < 


On Wed, Apr 14, 2021 at 7:54 PM 
e Monday ttam-em, 1pm, 2-3:30pm 
e Tuesday 49:39am or 4pm 


e Wednesday 1-2pm XK 


On Wed, Apr 14, 2021 at 4:48 PM 
Just wanted to follow up and see w 
with the White House team. I'm wor 
comments. 


¢ 
Thanks, N 
eal 


e 
On Tue, Apr 13, mg  < 20021¢.com> wrote: 


Hi Team - 


@google.com> wrote: 


@google.com> wrote: 


uld work for this group (MM for hearing prep) to meet 
on a draft deck, found here, and will start adding in folks for 


We heard back ee House this evening, and they wanted to propose the below dates next week: 
e Monday 112 nZ m, ipm, 2-3:30pm 
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On Tue, Apr 13, 2021 at 11:53 AM @google.com> wrote: Y) 
We can also share Google Search trends for covid|19 vaccines. Does YT have similar trend data? wm 


No, we do not. Oy 


On Tue, Apr 13, 2021 at 6:08 AM Po Vgoogle.com> wrote: Y 
Good Morning, my recommendation would be to schedule an internal sync to update y Covidl9 
Misinformation Deck with the latest information on our efforts with a deeper divgag be as Rob's 
questions were very YT focused. In our last meeting, Rob particularly dug in o decision making for 
borderline content. We can also provide an update on the on-going YT creators Tagerview collaborations. 


We can also share Google Search trends for covid!9 vaccines. Does eye trend data? 


Could we ask Rob to schedule the meeting for next week to give us tO Perpare? 


| re awareness and help prepari nother WH meeting on covid 


vaccine misinformation. 


— Government Affairs and Public Policy 2 


Washington, DC 20001 
@google.com 


Android Mobic: & 
On Mon, Apr 12, 2021 at 10:12 PM CR < 2 20021¢.com> wrote: 


Hey Jan, O 


Let's discuss this in our sync to 


Date: Mon, Apr | 


Subject: Re: Vaccin 
To: Flaherty, RoDRQP 
O. 


Op.gov> 
<2 eoogle.com>, ee 2 20021¢.com> 
Hate) 


fs: -dding in no 


ti@s for them and broader teams. 


2, 
& 


@who.cop.gov>, Qureshi, Hoor EOP/WHO 


vho will shepherd. Your primary interests are all key 


to help, 


© 
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_ On Mon, Apr 12, 2021 at 3:01 PM Flaherty, Rob EOP/WHO < 


wrote; 
Heya -- A while ago, I met with folks from Google about misinformation and COVID-19. Was ho ) 
to connect again with folks from your side about the work you’re doing to combat vaccine nse 
but also crack down on vaccine misinformation. Y 


I think we’re primarily interested in: 


° Trends that you’re seeing generally around vaccine misinformation on Youtube 
® The empirical effects your efforts to combat it have had, specifically: “whae sf” 
° What interventions you might currently be trying 


® Ways the White House (and our COVID experts) can partner in your product work 


Would be good to get this on the books later this week and then try toga ityecurring Hoor can 
wrangle calendars on our side. 


~ 


Rob Flaherty < 
Director of Digital Strategy O 
The White House 


- On mobile: 


_ Strategic Partner Manager, Civics 
- YouTube DC & LA y 
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YouTube |} oogle.com |) 


| Google Public Policy || 
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Exhibit 101 


Internal email correspondence 
between YouTube & Google 
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Message 


From: EEE II cooste com Y 


Sent: 4/13/2021 1:08:41 PM sp) 
eae (© c00¢le.com); TT PE © ¢00¢le.com); Qy 


google.com] 
cc: @google.com] 
Subject: Re: Vaccine Misinfo N 


Good Morning, my recommendation would be to schedule an internal syne to update oust Bo is10 
Misinformation Deck with the latest information on our efforts with a deeper dive on Y oughaslagyas Rob's 
ec 
iew 


questions were very YT focused. In our last meeting, Rob particularly dug in on our d on making for 
borderline content. We can also provide an update on the on-going YT creators interview c8llaborations. 


We can also share Google Search trends for covid!9 vaccines. Does YT SS nd data? 
re: 


Could we ask Rob to schedule the meeting for next week to give us time 


| Eo: awareness and help preparing Fags WH meeting on covid vaccine 


misinformation. 


Ee Government A ffairs and Public Policy < 

Washington, DC 20001 @) 
Agoogle.com 

Android Mobile: 


On Mon, Apr 12, 2021 at 10:12 PM 
Hey 


ole.com> wrote: 


Let's discuss this in our syne tomorrow. 


2. 202 


=~ = 


Date: Mon, Apr | 


® 
Hey Ro ww 
Penge. ing in | OR | will shepherd. Your primary interests are all key priorities for 
them a Rbroader teams. 
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On Mon, Apr 12, 2021 at 3:01 PM Flaherty, Rob EOP/WHO <I @ who.cop.gov> wrote: Y 


Heya -- A while ago, I met with folks from Google about misinformation and COVID-19. Was hoping 
connect again with folks from your side about the work you’re doing to combat vaccine hesitancy, buseg 
crack down on vaccine misinformation. Yon 


I think we’re primarily interested in: WO 


* Trends that you’re seeing generally around vaccine misinformation on Youtube 
e The empirical effects your efforts to combat it have had, specifically: “what's g 


8 What interventions you might currently be trying 
s Ways the White House (and our COVID experts) can partner in your wed 


Would be good to get this on the books later this week and then try to mak fi 


calendars on our side. 
-Rob gy 


Rob Flaherty O 
Director of Digital Strategy 
The White House 


g. Hoor can wrangle 


Cell: ae 


On mobile: 


Strategic Partner Manager, Civics y 


YouTube DC & LA ~N, 
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Exhibit 102 


Zoom invitation for meeting between 
YouTube and the White House 
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Appointment Z 


From: Google Calendar [calendar-notification@google.com] %) 
Sent: 4/16/2021 5:10:07 PM 

To: Flaherty, Rob EOP/WHO GE © wh0.cop.gov] 

Subject: YouTube Vaccine Misinfo Briefing Y) 
Attachments: invite.ics 

Location: Y 

Start: 4/21/2021 5:00:00 PM 

End: 4/21/2021 6:00:00 PM 


Show Time As: Tentative 


| “© 
‘Recurrence: (none) ~ 


=a has accented this invitation. 
oultube Vaccine Misinfo Briefing 
When Wed Apr 21, 2021 1pm — 2pm Easter: Time - New ¥¢ € 


Calendar Flaherty, Rob EOP/WHO 


Who . Flaherty, Rob EOPWHO - organize O 


« Slavitt, Andrew M. EOPAV 


eng pc - optional 
« Fitzpatrick, Kelgey V. EOP/WHO - ontiona! 


White House staff to get briefed olf ube on general trends seen around vaccine misinformation. As well as, the 
empirical effects of YouTuhe’s ‘© combat misinfo, what interventions YouTube is currently trying, and ways the 
White House (and our C ) can partner in product work. 


Hi there, Y) 


Hoor Qureghi | Linvit g you to a scheduled ZoomGov meeting. 


Join Zo ing 


5 
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Meeting URL: 


Meeting ID: 


L 
& 
ey o 


Passcode: 
& 
= Y 

Join by Telephone RS 


For higher quality, dial a number based on your current location. 


Dial: < 


Meeting ID: XK 


Passcode: 


International numbers O° 
Join from an 00 


H.323: Y) 


¢ 
== 
tem 
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Passcode: 


SIP: 


sip. ZoOOMgoV.com 


Passcode: 


invitation fromm Google Calendar 


You ére recely 


ing this courieay emai at the account robert flaherty@iwhoa eop.gov becd you are an attendee of this event. 


af sign up for 4a Googis account at 
lire calendar. 


siving future undates for this 


figalendar googie com/calendar? 2! 


Forwarding this invitation could allow any recipient tc send a respongg to 
regardless of trelr own invitation status, or to m arn 


oO 


® 


i * 

ww 
ES 

O 
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Exhibit 103 


Internal email correspondence between 
YouTube & Google 


Message 
From: SES GE ©: 00¢!¢.com 5, 


Sent: 4/22/2021 1:53:49 AM 9) 
To: SNE IE? 002.017 Qy 


cc: SE €00c: 0) TE Ocoee com); aT 
ee a 


Subject: Re: Trends re: vaccine hesitancy 


Yeah. They're looking to crack vaccine hesitancy in the middle---those who can be conygmgec@€-afid is trying to 
better understand what borderline trends may look like here. 


On Wed, Apr 21, 2021, 6:52 PM x <I coogle.com> wrote: 
€'y 


Just to be clear on the question - are they looking for more than the data availabl you filter by YouTube 


in Google Trends (as seen below)? 


% covid vaccine e 
aE + Caspase 
Prine Hao Me onthe ¥ Atiovingatioe ¥ Youtwie Guat v 
mvetest wer Uisse So yet 


e ©. & Yotenx SASS 


Nik Ceviete fee acres Onoy orton fo chohuaet Upioud te Ganga home My scant & 


On Wed, Apr 21, 2021 at 3:46 PM @google.com> wrote: 
Adding : do y@u, know if we'd be able to pull search trends on COVID for YT to help answer 
the White House's question o information about the COVID vaccine? 


e 
as 
49 AM deoogle.com> wrote: 


On Wed, Apr 21, oh 
one other piece of cOftext--we often point US government officials to Google Search COVID trends when 
asked about “a9 aaa trends or about vaccine searches. Does YouTube see the same trends as Search? 
Is there any W ow external stakeholders similar YouTube trends? We anticipate US Government's 
focus omya¢ Fine) sitancy to increase as vaccine supply increases and demand possibly levels off this 


summe€. A 
Tha Ly marketing to loop in YouTube on the broader vaccine communications plans as we enter 
c hase with the launch of vaccine.gov on May 1. If there are new YouTube efforts we should be 


for vaccine hesitancy please let us know. 
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Google Government Affairs and Public Policy 


Washington, DC 20001 


HE 200 gle.com Oy 


Android Mobile: iia Q) 
On Wed, Apr 21, 2021 at 2:31 PM @google.com> wrote: N 
We already have that, thank you. Really he's interested in what we're seeing that is | 
well as whether removals have been more heavily concentrated in any particular ag 
fair to say that we're not seeing content trends concentrated in any specific area o 


continue to action content that violates our policy writ large? 
-C ) 


On Wed, Apr 21, 2021 at 11:25 AM 6 ~~. wrote: 
me CO 


jng down, as 
our policies. Is it 
policies, but that we 


Exhibit 93 » 
I don't have any qualitative info on trends, Re we could pull u of videos we've removed for 
COVID vaccine misinfo, if that would help? 


_ On Wed, Apr 21, 2021 at 8:04 Mii 
i a oc 


GE and | just got off ofa call with the wong 


@google.com> wrote: 


0 are extremely interested in what we may be 
observing re: vaccine hesitancy on YT. I do noMgfow if we have any of this type of information, but... do 
you have any qualitative info re: things welve obsefwed, trends in content and related messages, etc that 
we could offer to Rob? x 


Thanks! O 


oogle.com 
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Exhibit 104 


Internal email correspondence 
between YouTube & Google 
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Message 
From: GS © coogie.com) Z 


Sent: 4/22/2021 1:36:48 AM 


To: EE GE © £00¢!°.corr| 


[& Op @google.com] 


Subject: Re: (GAPP only) Fwd: Following Up on Today's Conversation ge 


Thanks J. completely agree. 
Mj - | put some time on your calendar tomorrow to discuss potential next steps forwar 


On Wed, Apr 21, 2021 at 8:41 PM TE ©2002. com> wrote; 
Sorry two points: 1) on closer read, sounds like he is working with Stanford; 2) I'f cocerned about this 


statement: "I appreciated your unequivocal response that you are not it. ti-vaccine content" 


That's not what either of us said. 


On Wed, Apr 21, 2021, 5:22 PM E <G coogle 


Hi both, 


I defer to you on how to manage, but we've already shared as muc we have to share here. I don't see value 
in a biweekly meeting, and I also don't think we have much oe in terms of trends. Just want to set 
expectations. He's basically asking for intel on mut ie) Sort s not something we can provide. I do 
think the Stanford work can provide the kind of insi ie oxing for, so maybe we can connect them if 
they're not already connected. 


---------- Forwarded message --------- 
From: Flaherty, Rob EOP/WHO 
Date: Wed, per. a 2021, 5:05 PM 


@google.com>, 
@google.com>, 


x00¢gle.com> 
pe Slavitt, Andrew M. gO 


@who.eop.gov>, Humphrey, Clarke EOP/WHO 


the conversation today. 
e top trends that you’ve seen in terms of misinformation around the vaccine. 


move away from a supply problem toward a demand problem, we remain concerned that 
nneling” people into hesitance and intensifying people’s hesitancy. We certainly neonaniee that 
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levels of the WH, so we'd like to continue a good-faith dialogue about what is going on under the hood here 
I’m the on the hook for reporting out. 15 


Just before we were meeting, this article from Buzzfeed popped, highlighting the Youtube misinfo 

that is spreading through the Vietnamese community. I think this brings up a question that I had in 
- meeting about your capabilities around misinformation in non-english-speaking communities. C 
- work to be done here. Would love to get some insights from you on how you are tackling thi eu across 
- all languages — how your enforcement has differed in languages and what your road map to i vemnent is. 


A couple of other things it would be good to have from you all: 


« As mentioned up top, the top trends that you’re seeing in terms of misinforma esitance inducing 
content (Stanford has mentioned that it’s recently Vaccine Passports and J&J pause-re stuff, but ’'m not 
sure if that reflects what you're seeing) C) 

ne that watch time is your 


« A deeper dive on reduction and its effectiveness. It’s helpful that yo op, 
key metric. I believe you said you reduced watch time by 70% on “borderlin 
Obviously, the term “borderline” is moveable, but taking it for what it #; 
related content specifically (removing the “UFO stuff’). What has vat 


ent, which is impressive. 
es that track with vaccine- 
ative reduction in watch time 
€ increase in watch time been 


£ 


on “borderline” vaccine topics been after your interventions? And what hajt 
on authoritative information? 


_¢  T appreciated your unequivocal response that you are not nmending anti-vaccine content and you 
are lifting authoritative information in both search and recommendations to all audiences. Related to the 
second bullet: to what extent have your ranking interventio en effective there? And, perhaps more 
critically, to what degree is content from people who hay, iven a “strike” still being recommended and 
shown in prominent search positions? 


e I feel like I am not coming away with a very picture of how you’re measuring the effectiveness of 
_ uplifting authoritative information. I obviously buy th®heory — but how did you arrive on info-panels as the 

best intervention? And to what extent are peopl@%elicking through after exposure to vaccine-hesitant content? 

What are you doing mechanically to boost th tative information? When you have relevant influencers 
_ speak to experts, I imagine (hope?) it’s mgt ering the content out there and that you’re recommending it 
- to people for whom it would be most ow does that work? 


people see the “borderline” content — or really just vaccine- 
mendations? Search? 


e What are the general vectors by 
_ skeptical content? Is it largely through reco 


VA 


We are excited to continuing fiartnering with you on this work as we have via John and Brandon, but we want 
- to make sure that the work e i, the broader problem. Needless to say, in a couple of weeks when we’re 
having trouble getting nel Pe vaccinated, we'll be in the barrel together here. We’ve worked with a 
number of platform pa toenfack down similar information based on internal data, including partners of 
- similar scale. I am feeli like I don’t have a full sense of the picture here. We speak with other 
platforms ona —— asis. We'd love to get in this habit with you. Perhaps bi-weekly? 


Looking fo ard Pig conversation. 


: -Rob an 
Rob F; .<S 
Direct@g of Digital Strategy 
ité House 


Cel 
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Email correspondence between 
YouTube and the White House 
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Message 

From: Flaherty, Rob EOP/WHO (gO who.eop.gov] "5 
Sent: 4/23/2021 9:48:43 PM 9) 
To: EE (© coogie.com] by 


cc SS GE 2 c°0cle or) TS EE O200cle.cor|; I @eooele.c 


GEE? 002 07; EP c00cle.con; @ google.com]; Slay M 
EOP/WHO @who.eop.gov]; Humphrey, Clarke EOP/WHO  Quwh p.gov]; 


Fitzpatrick, Kelsey V. EOP/WHO (© who.eop gov] 
Subject: RE: [EXTERNAL] Re: Following Up on Today's Conversation Y) 


GE — Belatedly confirming receipt here, and will follow up. 


From: 


ED © googie.com> 
Sent: Thursday, April 22, 2021 3:48 PM NN 


To: Flaherty, Rob EOP/WHO <I who.eop.gov> 
Cc TE EE © £002'¢.con> TT <P © coogle cn 
google.com; ® coogle.com; 


EOP/WHO <i @ who.eop.gov>; Humphrey, Clarke EOP/WHO 4 


Fitzpatrick, Kelsey V. EOP/WHO <i @ who.eop.gov> 


Subject: [EXTERNAL] Re: Following Up on Today's Conversation 


@google.com; 
gle.com>; Slavitt, Andrew M. 
@who.eop.gov>; 


Rob - 
Thank you for your time yesterday. We appreciate th Sa to work closely with you to address 
your concerns related to COVID-19 misinformatigf, a re specifically our work to connect our 
users with reliable, authoritative information rel o COVID-19 vaccines. We are happy to ensure 
we maintain regular communication with you to coRtinue to discuss our work as well as to provide 


regular updates. KX 
i ErmPtion to address your concerns: 


e Here is our YouTube COVID heet that provides additional detail on relevant and 
partnerships. Of note, | wanted to high!f@bt that 89% of YouTube videos removed for dangerous or 
misleading coronavirus misinformatign were removed with 100 views or less. 

° | also wanted to share this oVerview of our work in responding to the COVID-19 pandemic, our 


COVID-19 Medical Misinfomnitig n Policy that we continue to work closely with CDC and other health 
authorities to further ions explanation of enforcement and penalties. YouTube works each 


| would also like to provide the followin 


day to enforce our policie ially and consistently, and we do not have speaker-based 
exemptions in our enf : 
° With regard to ing information about trends, we have shared your request with our team 
to see what addition@l infSrmation could be provided. In the interim, as we discussed on the call the 
Google Trends to s down search trends for YouTube as well and can be a powerful tool to 
provide real time Gepratn on what is being searched for on YouTube. For example, here is the 
current YouT 


rch trend on COVID-19 vaccine. 


° In o your question about borderline content, we are happy to work with our team to 
provide fa more information on our work to address borderline content and will follow up with 
you so e€ meantime, |’m attaching a PDF that explains the signals we take into consideration 
when regormending content to users so you can better understand the many factors at play. 


Ma rning systems take time to adjust to updates, meaning that as we work to improve our 
il dentify and reduce recommendations of new vectors of borderline content—including 
vac@ine misinformation—there will be some lag in how this reflects in user recommendations. 
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° | wanted to share this blog post with you that highlights specifically to support education 
around the COVID-19 vaccine. |n the post, MM (YouTube’s Global Head of Healthcal@/ ) 
and Public Health Partnerships) provides detail on our work with local health authorities and 
community-based health organizations, our new multimillion-dollar campaign to address vaccig£A) 
hesitancy in countries around the world, and our continued efforts to connect creators with tr 

health experts to make information about vaccines more accessible and relatable. 

° As we discussed on the call, YouTube is continuously testing and evaluating new to 
improve our product. Here is a comprehensive list of some of our current test features 


experiments. | want to specifically highlight the test we announced on April 12 that BO improve 


critical thinking when consuming information online. As you know, the promotio id literacy and 
improving understanding of YouTube is a high priority and the driver behind r efforts to 
improve transparency, which includes the launch of our How YouTube Works 

e Finally, | wanted to share the metric we recently published in our Transparefcy Report called 


Violative View Rate (VVR). VVR helps us determine what percentage of viéws on YouTube comes 
from content that violates our policies. Our teams started tracking this 17, and across the 
company it’s the primary metric used to measure our responsibility wor most recent VVR is at 
0.16-0.18% which means that out of every 10,000 views on YouT come from violative 
content. This is down by over 70% when compared to the same % f 2017, in large part thanks 


to our investments in machine learning. It is important to note that t at applies to all content on 
YouTube, in all languages. 


’ll be in touch next week regarding a follow up briefing, but in interim please don’t hesitate to give 
me a call if there is anything else YouTube can do for me 


Best, O 


On Wed, Apr 21, 2021 at 8:05 PM Flaherty, Rob E who.eop.gov> wrote: 


' All — Thanks again for the conversation today: 


- We'll look out for the top trends that you’ve@een in terms of misinformation around the vaccine. 


' To recap: As we move away from a supply¥problem toward a demand problem, we remain concerned that Youtube is 
_ “funneling” people into hesitanceyand intensifying people’s hesitancy. We certainly recognize that removing content 
_ that is unfavorable to the cause ofi asing vaccine adoption is not a realistic — or even good — solution. But we want 


- to be sure that you have a han e ccine hesitancy generally and are working toward making the problem better. 
- This is a concern that is shar: t highest (and | mean highest) levels of the WH, so we'd like to continue a good- 
_ faith dialogue about what n under the hood here. I’m the on the hook for reporting out. 


Just before we were , this article from Buzzfeed popped, highlighting the Youtube misinformation that is 


' spreading through i@tnamese community. | think this brings up a question that | had in our first meeting about 
» your capabilitie isinformation in non-english-speaking communities. Clearly, more work to be done here. 
_ Would lovegto e insights from you on how you are tackling this problem across all languages — how your 
enforce ered in languages and what your road map to improvement is. 


A sine r things it would be good to have from you all: 
e ntioned up top, the top trends that you’re seeing in terms of misinformation/hesitance inducing content 


ta nforg has mentioned that it’s recently Vaccine Passports and J&J pause-related stuff, but I’m not sure if that reflects 
" what you’re seeing) 
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ie A deeper dive on reduction and its effectiveness. It’s helpful that you mentioned that watch time is your key 
_ metric. | believe you said you reduced watch time by 70% on “borderline” content, which is impressive. Obviously, t 
' term “borderline” is moveable, but taking it for what it is: How does that track with vaccine-related content speci 
(removing the “UFO stuff”). What has the comparative reduction in watch time on “borderline” vaccine topics b 

_ after your interventions? And what has the increase in watch time been on authoritative information? ly 


° | appreciated your unequivocal response that you are not recommending anti-vaccine content an 

_ lifting authoritative information in both search and recommendations to all audiences. Related to the s ullet: to 
' what extent have your ranking interventions been effective there? And, perhaps more critically, to wh ee is 

- content from people who have been given a “strike” still being recommended and shown in reriy ch 

| positions? 


ie | feel like | am not coming away with a very clear picture of how you’re measuring t vEness of uplifting 
' authoritative information. | obviously buy the theory — but how did you arrive on info-panels asthe best intervention? 
And to what extent are people clicking through after exposure to vaccine-hesitant creda are you doing 


- most relevant. How does that work? 


is What are the general vectors by which people see the “borderline” coh} really just vaccine-skeptical 
_ content? Is it largely through recommendations? Search? 


We are excited to continuing partnering with you on this work as we fff ia and (i, but we want to make 
_ sure that the work extends to the broader problem. Needless to say, ouple of weeks when we’re having trouble 

' getting people to get vaccinated, we'll be in the barrel together here. We'We worked with a number of platform 

_ partners to track down similar information based on internal stage partners of similar scale. | am feeling a bit 
_ like | don’t have a full sense of the picture here. We speak a ©®) 


get in this habit with you. Perhaps bi-weekly? 
_ Looking forward to more conversation. 


m XY 
k © 


atforms on a semi-regular basis. We'd love to 


_ Rob Flaherty 
- Director of Digital Strategy 
_ The White House 


Cell: ? 


wis 
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Message 


From: Flaherty, Rob EOP/WHO [EEO who.eop.gov] Z 


Sent: 4/22/2021 12:05:16 AM op) 
To: google.com); i G® coocle.com); 
(© google.com]; M@coogle.com; @ google.com; HM coogle.com; ay 
Dgoogle.com] 
GC: Slavitt, Andrew M. EOP/WHO [EO who.eop.gov]; Humphrey,Clarke EOP/WHO Y) 
| wh o.cop.gov); Fitzpatrick, Kelsey V. EOP/WHO (EO who.eo 
Subject: Following Up on Today's Conversation 


All — Thanks again for the conversation today. 


We'll look out for the top trends that you’ve seen in terms of misinformation around thegfdtcine. 
of 


To recap: As we move away from a supply problem toward a demand problem, i a Sve that Youtube is 
“funneling” people into hesitance and intensifying people’s hesitancy. We certain|yme ize that removing content 
that is unfavorable to the cause of increasing vaccine adoption is not a realistic rev n good — solution. But we want 
to be sure that you have a handle on vaccine hesitancy generally and are workifgtoWard making the problem better. 
This is a concern that is shared at the highest (and | mean highest) level so we'd like to continue a good-faith 
dialogue about what is going on under the hood here. I’m the on the br reporting out. 


Just before we were meeting, this article from Buzzfeed popped, highlightifg the Youtube misinformation that is 
spreading through the Vietnamese community. | think this brings question that | had in our first meeting about your 
capabilities around misinformation in non-english-speaking co wgities. Clearly, more work to be done here. Would 
love to get some insights from you on how you are tacklinggthi bral) em across all languages — how your enforcement 


has differed in languages and what your road map to imgfovegfnent Is. 


A couple of other things it would be good to have framp»you all? 

e As mentioned up top, the top trends that you ing in terms of misinformation/hesitance inducing content 
{Stanford has mentioned that it’s recently vaegreoapor and J&J pause-related stuff, but I’m not sure if that reflects 
what you’re seeing) 

° A deeper dive on reduction and it 


ss. It’s helpful that you mentioned that watch time is your key 
metric. | believe you said you reduced watch tame by 70% on “borderline” content, which is impressive. Obviously, the 
term “borderline” is moveable, but taking it for what it is: How does that track with vaccine-related content specifically 
{removing the “UFO stuff”). What has theffomparative reduction in watch time on “borderline” vaccine topics been 
after your interventions? And wh s the increase in watch time been on authoritative information? 


° | appreciated your unequi sponse that you are not recommending anti-vaccine content and you are 
lifting authoritative information search and recommendations to all audiences. Related to the second bullet: to 
what extent have your ranki ntions been effective there? And, perhaps more critically, to what degree is 
content from people who h given a “strike” still being recommended and shown in prominent search 
positions? 


authoritative inform obviously buy the theory — but how did you arrive on info-panels as the best intervention? 
And to what extef ople clicking through after exposure to vaccine-hesitant content? What are you doing 
mechanically to Joost e authoritative information? When you have relevant influencers speak to experts, | imagine 


° | feel like | am ie: away with a very clear picture of how you’re measuring the effectiveness of uplifting 


(hope?) it’ juseputting the content out there and that you’re recommending it to people for whom it would be 
most relev oW does that work? 
° ré the general vectors by which people see the “borderline” content — or really just vaccine-skeptical 


conte t largely through recommendations? Search? 
ited to continuing partnering with you on this work as we have via [inc i but we want to make 
sure that the work extends to the broader problem. Needless to say, in a couple of weeks when we’re having trouble 
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getting people to get vaccinated, we'll be in the barrel together here. We’ve worked with a number of platform partne 
to track down similar information based on internal data, including partners of similar scale. | am feeling a bit like Id 
have a full sense of the picture here. We speak with other platforms on a semi-regular basis. We’d love to get in thi 
habit with you. Perhaps bi-weekly? 


Looking forward to more conversation. Oy 
-Rob WO 


Rob Flaherty Y 
Director of Digital Strategy 


The White House 
Cell: 
-C ) 


NY 


) 


nf 
0 
o 
O 


~ 


o 
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Message 

From: EE © <00¢le.com) 5 
Sent: 4/22/2021 7:06:47 PM oe) 
To! SE GE 2 <002!2.com] (o 


cc ES GS? 00c!2 or) ES GEE © coocle.com] 
Subject: Re: White House Discussion on Borderline Content NY 
Thanks so much jf, really appreciate your help on this. I'll find some time on your calen Pry > next week 


and we can take it from there. 


On Thu, Apr 22, 2021 at 2:00 PM a I @ coogle.com> wrote, 


Sure I'd be happy to do that. Would be good to review the logistics again a d how my briefing will 
be used to appropriately calibrate what I say, like we discussed last time with othetical congressional 
staffer review. 


On Thu, Apr 22, 2021, 10:38 AM A 22002 DV 
‘i 


As you saw from the email thread from [J yesterday, there is a vOty high degrce of interest coming from the 
White House now regarding vaccine misinfo/vaccine hesitagy and our work around borderline content. 
Unfortunately, the role of tech in addressing vaccine hesitg about to come under a massive spotlight 
particularly as the supply of the vaccine is soon set tgou pace demand. It also looks like the White House is 
very interested in our work on borderline content, ghd yrore’Specifically vaccine related content as well as our 
work to promote authoritative sources for vaccines. 


To begin to address these concerns, and ensure y issues with YouTube are promptly addressed, we 
wanted to see if you would be willing to pro op overview briefing to the lead White House digital staffer 
on our work to reduce borderline content: timing goes, we were hoping to get something on the 
books in the next two weeks or so to ything from potentially spiraling out of control. 


I'm happy to jump on a call today or ri ow to discuss further. Appreciate any help you can provide on 
this. 


\' 
. x 


ment Affairs & Public Policy Manage | 


Ge co30com 
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Message 
From: Qureshi, Hoor EOP/WHO GS © who.eop.gov) J 


Sent: 5/5/2021 3:28:06 PM 


To: GE GS @ c00c!e.com) 


cc: GE @coogle.com] 


Subject: RE: [EXTERNAL] [Update] YouTube "Get Back to What You Love" Vaccination PSA Efforts ge 


Confirmed for Monday 5/10 at 3pm. Sending the invite now! 


From: Qureshi, Hoor EOP/WHO 
Sent: Tuesday, May 4, 2021 7:26 PM 


To: EE SEE © g00g.com> 
Cc: EE EEE Occocle.com> of ) 
Subject: RE: [EXTERNAL] [Update] YouTube "Get Back to What You Love" oe rts 


Let me confirm with Rob he’s ok to push to Monday, and I'll send an invite as <<)" back from him! 


Thanks! ~) 


From: GE @ coogle.com> 
Sent: Tuesday, May 4, 2021 7:12 PM 
To: Qureshi, Hoor EOP/WHO <i @ who.cop.gov> 


Cc @google.com> 
Subject: Re: [EXTERNAL] [Update] YouTube "Get Back to What Gye Vaccination PSA Efforts 


| be I (cc's), nyse, 


om). 


Thank you, could we lock in 3 pm on Monday? Participan 


GEE 2 :0021¢.com) and 


Best, 


On Tue, May 4, 2021 at 7:00 PM oogie.com> wrote: 


Thank you! I'll check with our team and follow 


Have a good evening! ™N 


On Tue, May 4, 2021 at 6:59 fOr. Hoor EOP/WHO gS @ who.eop.gov> wrote: 


No worries, | also think is a better option. As of now 3-4pm is open on calendars, and we could probably 
make either 10am or s6mething in the 11am-12:30pm range work. 


soogle.com> 


em at all! Unfortunately, it looks like schedules won't be able to line up on Friday. Were there times on 
Md@pday that would work for you? 
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| ey 
On Tue, May 4, 2021 at 6:51 PM Qureshi, Hoor EOP/WHO <i who.cop.gov> wrote: Oy 
| 


Sorry hit send too early! The only times as of now that work on Friday are 10am and 2-2:45pm. Howev: es 


are constantly changing so possible things continue shifting! Ns 


From: Qureshi, Hoor EOP/WHO 
Sent: Tuesday, May 4, 2021 6:45 PM 


To: ES (EEE @c002le.com> 
Cc: IS <I © coogle.com> 
Se 


Subject: RE: [EXTERNAL] [Update] YouTube "Get Back to What You Love" Vaccination 


Let me check with Rob, but we may need to look at Monday if possible. Just s check with calendars on 
our end, does your team have availability on Monday? S 


Cc: oogle.com> < 
Subject: Re: [EXTERNAL] [Update] YouTube "Get Back to "CS ve" Vaccination PSA Efforts 


From: IS EEE O2oogle.com> 
Sent: Tuesday, May 4, 2021 6:28 PM 
To: Qureshi, Hoor EOP/WHO who.eop.gov> 


Good Evening - Unfortunately, one of our macrnbel up until 2:45 on Friday. Would it be possible to start 


then? x 
O 


Thanks, 


On Tue, May 4, 2021 at 3:02 PM == {HEP soogie.com> wrote: 


Thanks so much, I'm alice," team now and will follow up ASAP. 


= 


On Tue, May 4, (2:33 PM Qureshi, Hoor EOP/WHO <i who.eop.gov> wrote: 


Hi iday at 2:30pm work on your end? 


ay, May 4, 2021 1:38 PM 


{EP c00¢1e.com> 
‘EEE @ googie.com>; Wakana, Benjamin L. EOP/WHO 

@who.eop.gov>; Rowe, Courtney M. EOP/WHO {BO who.cop.gov>; 
umphrey, Clarke EOP/WHO <N who.cop.gov>; Qureshi, Hoor EOP/WHO 
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who.eop.gov> 
Subject: RE: [EXTERNAL] [Update] YouTube "Get Back to What You Love" Vaccination PSA Efforts Y) 


4 


ir 2] — My apologies for the delay. Adding in Hoor from my team who can help wrangle calendars. oe 


chat this week. I. 
-Rob Y) 


From: ES (EEE ©2002le.com> 
Sent: Tuesday, May 4, 2021 1:31 PM 

To: Flaherty, Rob EOP/WHO who.eop.gov> ‘ ( ) 
Cc: i (EE © coogie.com>; Wakana, Benjamin L. EOP/WH 
<( @ who. cop.gov>; Rowe, Courtney M. EOP/WHO 
Humphrey, Clarke EOP/WHO <I who.cop.gov> 

Subject: Re: [EXTERNAL] [Update] YouTube "Get Back to What You “,. 

Hi Rob - Q 

Hope you are having a good week. | wanted to follow up and if you had any availability in the next week or two 
for a followup meeting with members of our team to a @ ollow up questions from our last conversation. 


.ZOV>; 


ion PSA Efforts 


Thanks again! 
On Thu, Apr 29, 2021 at 7:25 PM (gm 200010 com> wrote: 


Rob - 


conversation, | wanted to see if you had any availability to meet next 

, the YouTube Director of Global Healthcare Partnerships, as well as 
program manager responsible for leading our efforts to reduce borderline 

work each day to raise authoritative content related to COVID-19 vaccines as 
mation, and are happy to dive as deep as needed to ensure you get any questions 
ose dates don't work, of course we are happy to accommodate your schedule to find 


As a follow up to this and our previo 
Thursday or Friday with 


GE. who is the You 
content. Both a 
well as combat harm i 

you may have anda 


a time that me 
Thanks a n@y 


—_. 
\ 


On We r 28, 2021 at 2:41 PM a SP @ google.com> wrote: 
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this. 


Best, Oy 
= 


On Mon, Apr 26, 2021 at 6:18 PM Flaherty, Rob EOP/WHO who.eop.gov> 
Awesome. Cool spot. Assume this is targeting everyone on YT, but whats frequency/r @) like on this? 


Apologies for the delay in responding, but wanted to confirm receipt and will follow up as soon as possible "® 


Fromm: i EE © 200gle.com> 


Sent: Monday, April 26, 2021 6:13 PM 
To: Wakana, Benjamin L. EOP/WHO : : ; Row®, Courtney M. EOP/WHO 
who.eop.gov>; Humphrey, Clarke EOP/WHO < .eop.gov>; Flaherty, 
Rob EOP/WHO <@ who.eop.gov> 
Cc: I 4B ©z002e.com> 

Subject: [EXTERNAL] [Update] YouTube "Get Back to What You oY 


ion PSA Efforts 
Hi all, 


Today YouTube launched the first chapter of a public sate announcement series in partnership with 


the Vaccine Confidence Project at the London School iene & Tropical Medicine to encourage people to 
get informed about the COVID19 vaccines. Whe for our PSA campaign will run across 
YouTube, as weil as on television, radio a id social posts through July, with the goal of 


reaching Americans between the ages of 18 4, a key demographic to help control the spread of 
the virus. To watch the full series of PSAevideos, and additional content from local health 
authorities, visit youtube.com/vaccineinfa will have more to share on our vaccine communications efforts 
across Google as we move into May. Plea Pine know if you have any questions or feedback. 


Thank you, 
HB on behalf of the Google and YouTube Team 


Google Governmen®Affai Public Policy 
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— ‘Government Affairs & Public Policy Manager, 


: oogle.com |) 
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& Public Policy Manager, | 
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Message 
From: EE © <00¢!e.com) Z 


Sent: 5/4/2021 11:10:49 PM 9) 

To: SEE © ¢008!¢.corn] 

cc SES GEE 2c0°cl:. or) A A cooler); Oy 
GE @ coogie.com) 

Subject: Re: White House Meeting Request WO 


Thank you both, I'll lock in that time and you will receive the calendar invite from the Vyiry @). staff. 
Have a good evening! 


On Tue, May 4, 2021 at 7:05 PM Agee 


Yes I can move somethings to make it work. 


On Tue, May 4, 2021 at 6:04 PM yg < @ g00gle.com> 2) 
2aere a bit. 


4 & ( } 
@google.con Ne tg 


30 minutes would work for me, longer and I may need to move thin 


On Tue, May 4, 2021 at 4:02 PM aaa @go0o > wrote: 
Thanks{jJ - but unfortunately there has been a change in planS%pd the White House staff want to see if 
we could push to 3 pm EST on Monday (5/10). Would gor for everyone? 


O 


Best, 


On Tue, May 4, 2021 at 2:54 PM 
Works for me. 


Acoogle.com> wrote: 


On Tue, May 4, 2021 at 1:36 PM @zgoogle.com> wrote: 


Hi Team - 


Apologies for the delayed response but the White House staff just got back and asked if it would be 
possible to do the meeting this Frigay (5/7) at 2:30 EST. If that won't work for either of you, I'm happy to 
see if we can identify a bette option. 


Thanks again, e Ry 
=a lS 


On Thu, Apr UU, at 6:47 PM a <2 200 21.com> wrote: 


Thank you! I W up with the White House and propose some dates/times based on your calendar 
availabili 


& 
Behe YS 


Looking forward to it! 


‘d 0 Thu, Apr 29, 2021 at 6:26 PM [i < @ coogle.com> wrote: 
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On Thu, Apr 29, 2021 at 3:12 PM [J @ o00g1e.com> wrote: 


Yes let's go for it. L 
On Thu, Apr 29, 2021 at 4:38 PM I © co 0gle.com> wrote: Oy 
ite 


land 


Over the last several weeks, the Google & YT GAPP team have had conversations wnGGeh 
House staff on YouTube's policies and all the great work that is being done to raise tive 
information and fight harmful misinformation related to COVID-19 misinfo ion 


The discussions have been good, and the information has been well received, staff continue to have 
questions on the raise/reduce efforts. Given these questions, particularly among th® backdrop of 
increasing levels of vaccine hesitancy in the US, we wanted to see if it wel fe possible for you both 
to participate in a meeting with the staff to provide an overview of ti ork. Again, the staff are 
familiar with many of our policies and efforts, but we believe having ts, eaten for you both to 
share more background would be hugely beneficial as we seek SS sely with this administration 


of the White House work with social media companies ress issues related to COVID-19. If you 
both would be available, we would like to request the m for next week given the significant 


on multiple policy fronts. 

The meeting would be with the White House digital dire sre, who has been leading a lot 
ee 

attention coming from the staff on this issue. < 


I'm happy to answer any questions or provide any, back pround as needed, and again appreciate your 
consideration of this request. 


Best Regards, 


- o 


Public Policy M 


2 c0ccle.com| 


anager, 
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Organizer: Flaherty, Rob EOP/WHO : i Qwho.ecop.gov 9) 
Subject: WH/YT Vaccination Efforts Follow-up Oy 
Location: 


Start Time: 2021-05-10T19:00:00Z Y) 
End Time: 2021-05-10T19:30:00Z 


Attendees: SEES (EEE 2200012.com 


Hi there, Y 


Hoor Qureshi is inviting you to a scheduled ZoomGov meeting. 
One tap mobile: 


Meeting URL: 


Meeting ID: XQ 
a OS 


Passcode: 


Join by Telephone ¢ 


For higher quality, dial on on your current location. 
& 
Dial: ~S 


MeetingJD: 


rages 
Cy numbers 
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Meeting ID: 


-_ WZ 


SIP: SO 
GEE @sip.zoomgov.com ~) 


Passcode: 


Join from an H.323/SIP room system 9) 
H.323: : Oy 


i * 
WO 
oo 
O 
~ 


o> 


© 
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Message 
From: SEES GE © <00¢!¢.com] 4, 


Sent: 5/24/2021 5:59:39 PM 


To: EF @ coogic.com); BE GE coogle.com) 
Ga 


foam ae 
cc: SES GEE © cccle. on), ES 2occle corn] ST PE © co 
SS GE? <00c!¢. or”) ED © 200216 com; 


google.com] ~& 


Subject: Re: [Exclusive]: "Biden, Fauci join forces with YouTube creators to combat Gen Z vaccine hesitanc 


G 


+ Admin team 


kudos all! 


On Mon, May 24, 2021 at 1:39 PM @google.co 
It's worth noting this quote from WH Digital Director Rob Flaherty (who, as 
on us at times): 


4 . 
cas knows, has been tough 


“We continue to be focused on making sure people are getting nse the vaccination through the 


messengers they know and trust,” White House digital director a told Yahoo News. “These 
influencers are just those messengers, and this town hall is anot p to reach and vaccinate young 
Americans who need protection from this deadly virus as we work®qachieve the President’s goal of 70 percent 
of adult Americans vaccinated by July 4.” < 


Full credit to J and fj for this huge win! 


On Mon, May 24, 2021 at 12:53 PM 
Hi -- flagging the story below re: the as 
Draft blog post here (will go out today). OS 
Here are the videos: 


White House Highlights Reel: Pre 
Jackie Aina: interviewing President Bi 


MannyMUA: | COLLABED WITH sean BIDEN! THIS IS NOT A DRILL! 
BraveWilderness: Big News fronfthe President! What did he tell us? 


Great stuff from the team (w, » ). 


O 


@google.com> wrote: 
vax interviews that are going live today. 


wonen----- Forwardgdey aannnnee= 
—— 


Date: Mon, . 2021 at 12:27 PM 
Subject:,f e|: "Biden, Fauci join forces with YouTube creators to combat Gen Z vaccine hesitancy" 
@google.com>, @google.com>, 


Q@google.com>, 


auc obgle.com>, 
<P. c00gle.com>, 


@google.com>, 


agoogle.com>, 


@google.com>, 
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le.com>, @google.com>, @google.com> 
Jooogle.com>, oogle.com>, 


<P ee00gle.com>, ‘BR <0 0¢le.com> 


Hi all, Oy 


To announce the Biden Town Hall creator video series, we partnered_with the White House ong usive 


reveal with Yahoo. The story is great, with quotes from our creators, AMBand White gital 
director Rob Flaherty, and it really showcases how helpful and successful YouTube hag, be@g/asja platform for 


the administration to share critical information about COVID with younger Americ 


We have distributed our press advisory out widely today and we are in process on a blogpost to go up later 
this afternoon. We'll share any additional press coverage later today or tomorro 


® 
Thanks everyone for your help in getting this out the door, particularly Joh 
Best, RY 


Biden, Fauci lokatorees with 
YouTube oe to combat 
Gen Z vaccine. esitancy 


WASHINGTON — Presi iden and Dr. Anthony Fauci are 
collaborating with a group opular YouTube creators in a series of 
virtual interviews to comfat rising vaccine hesitancy among younger 
Americans as part of&the White House’s broader push to get a majority 
of the country vac d by July 4. 


In the series of Mahtyet-released videos reviewed by Yahoo News, Biden 
and Fauci, sitin@xtogether at the White House, speak over Zoom Manuel 
Gutierrez 400) 1-year-old male makeup artist Known online as Manny 


MUA, Ja na, a 33-year-old social advocate and makeup artist, and 
Coyo son and Mark Vins of Brave Wilderness, a group of outdoor 
and a ture junkies. 

_ 
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In the YouTube interviews slated for release Monday, Biden and Fauci 
attempt to quell fears from parents who doubt the efficacy and safety Z) 
vaccinating their young children, address rumors of a federally 
mandated vaccine passports, and push vaccination as a social 
responsibility. The interviews also highlight the administration’s 
partnership with rideshare companies Uber and Lyft, which now ough 


Independence Day are offering free trips to and from desi nGied 
vaccination sites across the country. Q- 


“| think it's an obligation, an obligation to make sure that eVen if it's an 
even small percentage possibility that you could be afcagrier and spread 
the disease, that you have an obligation,” Biden t tierrez in one 
video, adding that the country has “the most g , the most 


informed, the most caring generation coming Sy 
ss, Biden also 


Speaking to Peterson and Vins of Brave 

highlighted vaccinations as a social responSybility for youth. Young 
people “should not be afraid of the notio§ that they're going to geta 
needle in their arm, that’s number py ause it doesn’t hurt,” he says. 


While conversations regarding vaxgiNe hesitancy have traditionally been 
centered around non-white and. Repwblican communities, a growing 
number of members of Gener have shown a reluctance to getting 
a COVID shot. Recent NB rning Consult polling found that adults 
between 18 and 34 are eson likely generation to say they will either 
not get vaccinated (23%) on't yet know (21%) with Gen Z adults 
particularly disinterested/ 
‘Eis 


Manuel Gutierrez Jr, of A speaks with Dr. Anthony Fauci and President Joe Biden during 
n Hall on COVID-19 Vaccination (Manny Mua/Y outube) 


President Biden's You 

That number he significantly compared to polling concucted in 

March of la r, when at the time only 5 percent of Gen Z adults said 
t the vaccine if offered. 


they wo 

Vins oo News the interview was an opportunity to arm their 
view any of whom regularly watch their videos with their family, 
withitnh® most accurate vaccine information available. 


“eWant them to be informed so they can make the best decisions 
Cogssivie | believe in preserving the freedom to choose whether or not to 
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be vaccinated, but having the information to make the right decision "2 


you is critical,” Vins said. 
Gutierrez, who also founded his own beauty line, told Yahoo nonesr 
his audience's largest age range is 18-24 and 25-30, and al paiQe a 


social responsibility to his viewers, even though his channel a 
focuses on beauty. 


ly 


“Just because I’m a beauty guru who loves to play with doesn't 
mean | don’t want to use my platform to help in other ar if | can,” 
Gutierrez said. 


_ The White House sees its collaboration with You 
_involved in Gen Z spaces as a prime opportuni 
_administration’s backyard BBQ's by July 4 dea 
According to data collected by The Manife 

watch YouTube videos at least once a wéel¥ 


ercent of Gen Z-ers 


During the onset of the pandemic, Fauciappeared in over a dozen 
_ interviews with several genres of Vin te creators to dispel rumors and 
_ answer common COVID questions; of those videos amassec over 


5 million views. 


Dr. Anthony Fauci (The White House) 

“We continue to be oousgdanrakin sure people are getting 
information about the vacciwation through the messengers they know 
and trust,” White House gigital director Rob Flaherty told Yahoo News. 
“These influencers just those messengers, and this town hall is 
another step to caper vaccinate young Americans who need 
protection fro adly virus as we work to achieve the President's 


goal of 70 per adult Americans vaccinated by July 4.” 
YouTube f at their platform has a social responsibility as well. 
“It's criti t we help motivate younger people to get vaccinated, and 


need to show up where they are, and that’s online, and on 
Dr. Garth Graham, Global Head of Healthcare and Public 
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Director, Govt Affairs & Public Policy 
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Washineton, DC 20001 Y) 
Google Voice N 
@google.com 
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Sent: 7/21/2021 1:03:37 AM 

To: Flaherty, Rob R. EOP/WHO (NO who.eop gov) 
cc SEE GEE @ 200812007] 

Subject: Re: [EXTERNAL] YouTube Announcement 

Rob, 


To clarify, the content was not in violation of our policies and therefore not subject t 
content on YouTube, we apply our 4R framework we have previously described to rais@ythoritative voices 


while reducing visibility on borderline content. External evaluators use these guidelines which are then used to 
inform our machine learning systems that limits the spread of borderline contept. 
Best Regards, Y 


On Tue, Jul 20, 2021 at 8:36 PM Flaherty, Rob R. EOP/WHO < 
So this actually gets at a good question — the content Dale poi 
therefore isn’t subject to recommendation limitations? < 


Sent from my iPhone O 


On Jul 20, 2021, at 8:27 PM le.com> wrote: 


~ 
Rob - . O 


I'll check with our team and share any data points we have available. Per our COVID-19 medical 
misinformation policy, we will remove afM content that contradicts local health authorities’ or the World 
Health Organization’s (WHO) medical information about COVID-19. To date, approximately 89% of videos 
removed for violations of this policy ere removed with 100 views or less. With regards to the specific videos 
you referenced, the content was%got in violation of our community guidelines. 


Best Regards, & Ry 
- & 
@ 


On Tue Gm 21 at 3:58 PM Flaherty, Rob R. EOP/WHO <] @ who.cop.gov> wrote: 


r goal — what is the actual number right now? 


@who.cop.gov> wrote: 
etined as “borderline” and 


I see SN 
es the content that Daniel Dale references in his tweet count as violative content that has slipped 


] y 4+ 
(> Or is it that generally the stuff he’s posting is in-bounds? 
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From: @googvle.com> 


Sent: Tuesday, July 20, 2021 2:36 PM 9) 
To: Flaherty, Rob R. EOP/WHO <q who.cop.gov> 

Cc @google.com> Oy 
Subject: Re: [EXTERNAL] YouTube Announcement Q) 


Thanks Rob, 


We appreciate your interest in our announcement yesterday. With regards to your_guestion on the Tweet, it is 
important to keep in mind that borderline content accounts for a fraction of 1% qf whet is watched on 
YouTube in the United States. We use machine learning to reduce the ree M®ns of this type of 
content, including potentially harmful misinformation. In January 2019, we a ced changes to our 
recommendations systems to limit the spread of this type of content whtg, top t¢d in a 70% drop in 
watchtime on non-subscribed recommended content in the U.S. and ouggO&liS to have views of non- 
subscribed, recommended borderline content below 0.5%. I will enjoined with any new policy or 
product improvements that we make as we continue our work t pewple 
information on YouTube. 


e find authoritative health 


Best Regards < 


On Tue, Jul 20, 2021 at 10:57 AM Flaherty, Rob PE © who.cop.gov> wrote: 


I’m curious: Saw this tweet. >>https? com/ddale8/status/1417130268859772929<<; 


| think we had a pretty extensive back and forth about the degree to which you all are recommending anti- 


vaccination content. You wege prettY emphatic that you are not. This seems to indicate that you are. What is 
going on here? 


Thanks! 0 


-Rob “ 
Deso0ogle.com> 


ey ly 19, 2021 1:27 PM 

To: Flafigcty Rob R. EOP/WHO 

@google.com> 
XTERNAL] YouTube Announcement 


@who.cop.gov> 
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We wanted to share an announcement that we recently made regarding a few new ways in whic 7 
_ we are making it easier for people to find authoritative information on health topics on YouTu 


_ Starting this week, you’ll see two new features next to some health-related searches and Wi ; 


These include a new health source information panel that will surface on videos to pro ntext 
about authoritative sources, and a new health content shelf that more effectively higiali ideos 
from these sources when you search for specific health topics. These context cue intended to 


help people more easily navigate and evaluate credible health information. 


To identify the sources that will be eligible to be included in these new featureSywe applied the 
principles recently developed and published by an expert panel convenegeby the National 
_ Academy of Medicine. & 


walk you through these new features or answer any questions have - please let me know 
what works best for you. 


Best Regards, 2 


You can find more information about our announcement here. ee to set up time to 


Public Policy Manager, | 
ogle.com | 
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Government Affairs & Public Policy Mana@e 


i 


YouTube |) ay A com | O 


’ 
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Message 


From: GE © coogie.com] 

Sent: 8/23/2021 11:29:19 PM 

To: Flaherty, Rob R. EOP/WHO (NO who.eop gov) 

cc ES GE 2 00¢!< 0) A EB Oc00¢12.com] 

Subject: Re: Pfizer Approval Y 


ing updates 
tinued efforts 
eh our marketing 


Hi Rob, Thank you for reaching out. A number of product teams across Google/YouTube are 
due to today's FDA announcement. I'll follow up in the coming days with more details on 

to raise up authoritative information on COVID19 vaccines both across our products an 

PSA efforts. I've also shared your language across the internal teams. Thanks again! Y) 


Google US Federal Government Affairs and Public Policy 2 


Washington, DC 20001 
@google.com 


NS 


BEE © eoogle.com 
Android Mobile i’ RY 
On Mon, Aug 23, 2021 at 9:50 AM Flaherty, Rob R. cor WGI 2 son 20. wrote: 


Team Google -- < 


_ Now that FDA has approved Pfizer, I’m making the r, n&) get a sense from the various platforms how (or 
if) folks are planning to promote it in any way. 


We'd appreciate a push here, given the fact that tHifis an oft-cited blocker for many folks. 


Suggested language from us: 
The COVID-19 vaccine has received fui! 
delta variant. If vou have been waiting for t 


vaccinated. i! 
Thanks! ® SO 


-Rob & 


Rob Flaherty 
Director of Digi 
The White H 


Cell: 


wroval from the BDA and protects agamst the more dangerous 
is approval betore getting the vaccine, now is the time to get 
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Message 


From: GE © co0cle.com] 


Sent: 9/29/2021 3:16:09 PM 

To: Qureshi, Hoor A. EOP/WHO GE © who.eop.gov) 

cc: Flaherty, Rob R. EOP/WHO (gO who.eop gov); @google.com] 
Subject: Re: [EXTERNAL] YouTube Meeting Request Y 
Thank you, please send to myself and Jan Antonaros (cc'd). Ry 


Look forward to the discussion. 


WO 


On Wed, Sep 29, 2021 at 11:04 AM Qureshi, Hoor A. EOP/WHO Daren TT wrote: 
Hi §? Let’s hold 2pm on 10/1. Let me know who all I should include from your end, and I’Il circulate an 
invite! O 
From: Si (GR. ©. 200g!e. com> SO 
Sent: Wednesday, September 29, 2021 10:53 AM ~> 
To: Flaherty, Rob R. EOP/WHO < @who.eop. 


Ce: Qureshi, Hoor A. EOP/WHO }who.eop. a 2 202 2!e.com> 


Subject: Re: [EXTERNAL] YouTube Meeting Request .< 
Thanks Rob, we are open after | pm on the Ist if "ee your end. 


On Wed, Sep 29, 2021 at 10:45 AM Flah@a R. EOP/WHO <q who.cop.gov> wrote: 


Awesome. The 1“ should work — Hoor can hélp land the plane on my calendar here. When works for you all? 


From: Scone 

Sent: Wednesday, Septembe 1 9:40 AM 

To: Flaherty, Rob R. EOP/V OMEN so c00 20.> 
Ce: Ugoogle.com> 

Subject: Re: [EXTERN ouTube Meeting Request 


Hi Rob - ~ 


No problem MS. are happy to set up something and discuss this further. I'm available this Friday (10/1) 
and am ged week as well. In the interim, you can learn more about the announcement we 
mad d a detailed overview of our policy in our help center here. Look forward to catching 
up SO 


Best Regards, 
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On Wed, Sep 29, 2021 at 9:23 AM Flaherty, Rob R. EOP/WHO {iE who.cop.gov> wrote: 


~— So sorry for not replying to this note. I thought I did. We’d welcome the meeting — I saw thefnews. 
Would love to talk through it — at first blush, seems like a great step. %) 


-Rob ‘fo; 


Sent: Tuesday, September 21, 2021 1:52 PM 2 


To: Flaherty, Rob R. EOP/WHO @who.eop.gov> 
Subject: [EXTERNAL] YouTube Meeting Request ss C) 


Hi Rob - SO 


Our YouTube Trust and Safety team is working to finalize a Cy to remove content that could 
I 
eet thi 


mislead people on the safety and efficacy of vaccines. We ike to preview our policy proposal for you 
and get any feedback you may have. Are you available to 1 s Friday (9/24) or Monday (9/27)? 


Best Regards, {2 


RS 


Governmettaas airs & Public Policy Manager, 
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788 


HIGHLY CONFIDENTIAL HJC-GOOG-00054089 


Exhibit 115 


Zoom invitation for meeting between 
YouTube and the White House 


789 


Organizer: Flaherty, Rob R. EOP/WHO : RY @who.ecop.gov ~ 
Subject: WH/YT Meeting Oy 
Location: 

Start Time: 2021-10-01T18:00:00Z 

End Time: 2021-10-01118:30:00Z 

Attendees: ‘GQ: s00gle.com 


Hi there, Y 
Hoor Qureshi is inviting you to a scheduled ZoomGov meeting. SO 


Join Zoom 


One tap mobile: 


Meeting URL: 


Meeting ID: XK 
dl XS 


Passcode: 


Join by Telephone ¢ 

For higher quality, dial on on your current location. 
y 

Dial: x» 

MeetingJD: Y) 


Pa > 
Oyo numbers< 
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Meeting ID: 


— WZ 


SIP: SO 
GEE @sip.zoomgov.com ~) 


Passcode: 


Join from an H.323/SIP room system 9) 
H.323: : Oy 


i * 
WO 
oo 
O 
~ 


o> 


© 
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Message 
From: Qureshi, Hoor A. EOP/WHO [EB @ who.eop.gov] Z 


Sent: 10/20/2021 9:07:24 PM 
To: SEES GEE @c00c!¢.corn] 
Subject: RE: [EXTERNAL] Re: 5-11 Vaccines 


Appreciate it! Will circulate an invite shortly. 


From: i EERIE © google.com> 
Sent: Wednesday, October 20, 2021 5:06 PM 


To: Qureshi, Hoor A. EOP/WHO < @ who.eop.gov> 
Subject: Re: [EXTERNAL] Re: 5-11 Vaccines 


@ 
No problem! Let's do 10am on Friday. Thank you! NS 


Nae ee 
Google US Federal Government Affairs and Public Policy ~~ 


Washington, DC 20001 


GE coogie.com 
Android Mobile aay 


On Wed, Oct 20, 2021 at 5:03 PM Qureshi, Hoor A. EOP/WHO : -Zov> wrote: 


| think earlier the better if possible. Also, please feel freg@to gen tions that do work on your end — and | can do my 


best to accommodate! 

From: Qureshi, Hoor A. EOP/WHO ~ 
Sent: Wednesday, October 20, 2021 4:53 P 

To: oogle.c 
Subject: RE: [EXTERNAL] Re: 5-11 Vaccines 


Aw so sweet! Actually, does vee Friday? If not, then yes let’s look at times for Wednesday! 


From: 


Sent: Wednesday, Octob 
To: Qureshi, Hoor A. EOP E .gZov> 
Subject: Re: [EXTERNAL} Re™§,11 Vaccines 


It’s actually my Q).. so | will be o00 on Monday and Tuesday. Does anytime on Wednesday work? 
® 


On Wed, Begheons at 4:48 PM Qureshi, Hoor A. EOP/WHO <i @ who.eop.gov> wrote: 
Hi =< rest of this week is fairly full across the board. What’s your schedule like early next week? 


r oogle.com> 
Seftt: Wednesday, October 20, 2021 4:44 PM 


793 


HIGHLY CONFIDENTIAL HJC-GOOG-00014837 


To: Qureshi, Hoor A. EOP/WHO <i @who.eop.gov> 
Subject: [EXTERNAL] Re: 5-11 Vaccines 


5-11 year olds. Would anytime tomorrow work on your end? 


Hi Hoor, i just wanted to check in to see if we could grab time tomorrow with Rob and team to discuss the a 


Google US Federal Government Affairs and Public Policy 


| 

Washington, DC 20001 

GEE? zoozle.com ® C) 
Android Mobile Y 


On Tue, Oct 19, 2021 at 1:01 PV 


Hoor, if you would like to send a few times that work best on your 


Thanks for reaching out! > 
Se) & 


Google US Federal Government Affairs and Public Palicy 
a O 
Washington, DC 20001 

Android Mobile: iii 


~~ 


On Tue, Oct 19, 2021 at 1@:58P, 
Happy to, Rob, and ad 


e'll lock in a time to connect. 


¢ 


oogle.com> wrote: 


to round out the team. 


Regthi ut because as you know, we are deep in preparation for the roll out of the vaccine for people aged 5-11. 

: hoping to share a bit about our strategy and the headwinds we think we’re going to be facing. We’d also 
like b download on your plans in this regard across your various surfaces and find areas of collaboration. Would 
OVE to find an hour to walk through it all at some point late this week or early next. 
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Hoor can help wrangle times on our end if you have any avail late this week or early next. 


_ -Rob 


The White House 


Cel: 


Rob Flaherty 24) 
Director of Digital Strategy 


On mobile: 


Strategic Partner Manager, Politics Creators © 


_ YouTube Content Partnerships 
Los Angeles, CA SO 


Google US Federal Government Affairs and Public Policy 
a  ) 
Washington, DC 20001 < 


Android Mobile: x 


~ 
WO 
Y 
we 
> 
© 
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Organizer: Flaherty, Rob R. EOP/WHO : gg Qwho.eop.gov 

Subject: 5-11 Vaccines (Google) 

Location: 

Start Time: 2021-10-22T14:00:00Z Y) 
End Time: 2021-10-22T15:00:00Z 

Attendees: ‘2: s00gle.com 


Hi there, Y 
Hoor Qureshi is inviting you to a scheduled ZoomGov meeting. SO 


One tap mobile: 


Meeting URL: 


Meeting ID: XK 
es OS 


Passcode: 


= 

Join by Telephone ¢ 

For higher quality, dial oO on your current location. 
& 

Dial: x 


MeetingJD: Y) 


rnational numbers 
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Meeting ID: 


Passcode: C) 
@ 
a SS 


SIP: SO 
GEE @sip.zoomgov.com ~) 


Passcode: 


Join from an H.323/SIP room system 9) 
H.323: : Oy 


i * 
WO 
oo 
O 
~ 


o> 


© 
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Message 
From: Qureshi, Hoor A. EOP/WHO GS @ who.eop. gov) Z 


Sent: 11/2/2021 12:14:29 AM 


To: HE GE @ <00¢le.com]) 


cc: GE @coogle.com] 


Subject: RE: [EXTERNAL] YouTube Meeting Request ge 


Hi 
Any time after 2pm on the 10" works as of now between Rob/Christian/Courtney. Any pref. n exact time? 


Let me know if so, and Ill place a hold on their end. 


Thanks! w 
From: i GD @ coogle.com> 
Sent: Monday, November 1, 2021 11:04 AM 


To: Flaherty, Rob R. EOP/WHO <® who.eop.gov> ) 
Q >. 


Cc: a EE © googie.com>; Qureshi, Hoor A. EOP/ reshi@who.eop.gov> 
Subject: Re: [EXTERNAL] YouTube Meeting Request 


Great, thanks Rob! < 
- O 


On Mon, Nov 1, 2021 at 10:34 AM Flaherty, Rob R. EOP who.eop.gov> wrote: 


Ai tae] — adding my colleague Hoor here who can.work ontiming. The 10th should work on our end. I'd like to add 
» Courtney Rowe and Christian Tom on our side as welbieppy to host at the White House. Just let us know! 


Sent from my iPhone 


On Nov 1, 2021, at 9:48 AM, aaa oogie.com> wrote: 


¢ 


_ Hi Rob - NN 


- YouTube's Vice President oral GE, is in town next week and wanted to see if it would be possible 

- to meet in person with y: nen er discuss YouTube's work to continue to address challenges related to COVID-19, 

as well as how we can s ik Ws, efforts related to the kids vaccine. Would you have any availability to meet after 2 
pm on Wednesday, No¥emb®s 10th? If that doesn't work, she also has some time on Monday (11/8) in the afternoon as 
well. 


war Y) 
oO 


Fa 
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From: SES “SEES <0 <or> 9) 
Sent: Wed 3/23/2022 8:43:21 PM (UTC) Oy 
To: “Wu, Tim EOP/WHO" <{@ who.eop.gov> 

Subject: Re: [EXTERNAL] Re: Two things. WO 

Great - lock in 10am - can u send us the zoom or call link? Y) 

On Wed, Mar 23, 2022, 3:53 PM Wu, Tim EOP/WHO @who. rote: 


10am works if it works on your side. " ( ) 
From: ES (MME 2.co0gle.com> _—-. -— 


Date: Wednesday, March 23, 2022 at 3:21 PM 
To: "Wu, Tim EOP/WHO" } 
Subject: Re: [EXTERNAL] Re: Two things. 


lpm ET tomorrow is best for us - but we might do 10 or 3 too 


On Wed, Mar 23, 2022 at 2:30 PM 


got it - be right back O 


PR © 2002 1e.com> wrote: 


On Wed, Mar 23, 2022 at 2 ae PM Wu, Tim EOP/WHO <{ who.cop.gov> 


wrote: 


Go ahead “3 times for tomorrow — thanks! 


nN i 
sday, March 23, 2022 at 11:18 AM 


Da 
To: im EOP/WHO" <i @ who.cop.gov> 
e: [EXTERNAL] Re: Two things. 


> chance u all have time tomorrow? one of our flight leads is on a flight at 4pm (ha...) 
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On Tue, Mar 22, 2022 at 6:19 PM a RR c00cle. com> wrote: 


Checking on 4pm 


And happy to chat Ukraine domestic 


On Tue, Mar 22, 2022, 6:04 PM Wu, Tim EOP/WHO < 
wrote: 


Ss of NSC / State 


briefings but did have extra questions more related nestic matters should someone 


be available 


From: 200g 
Date: Tuesday, March 22, 2022 at 4:02 
To: "Wu, Tim EOP/WHO" < 2who.cop.gov> 
Subject: Re: [EXTERNAL] Re: Twgthings: 


O 


keep holding Wed 3pm - sé ing on my end (sorry - product teams crazy with 
Ukraine right now) 


On Mon, Mar 21, a 12:06 PM Wu, Tim EOP/WHO <q @ who.cop.gov> 


wrote: 
& 


On the sro Morin -- how about tomorrow 2pm or Wed 3pm? 


DAt&,Saturday, March 19, 2022 at 2:18 PM 
tel 
jjec 


SS @Mgoogle.com> 


t: Re: [EXTERNAL] Re: Two things. 
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Different people on our side I’m afraid. Let’s stick with the airline stuff how about 330 9) 
or 4pm Monday? 


Sent from my iPhone 


On Mar 18, 2022, at 4:18 PM, 


wrote: 


can u let me know a couple of times you could do a call wZ we can 


probably get both topics on same call 


TE © c0021e.com> 


thanks! 


On Thu, Mar 17, 2022 at 4:35 PM 
wrote: 


got it - will circle right back 


Law Wu, Tim EOP/WHO 


wrote: 


On Thu, Mar 17, 2022 at 
awhos 


ld 
¢ 


Hope youteyvel! I wanted to reach out to you about two things. 
- Or 

ow. NEC, we’ve been the indirect beneficiaries of your NSC 

S 


s re: Russian misinformation / disinformation and how you’ve 
handling some of the challenges created by that situation. However, 
ad some NEC-specific questions as well. I wonder if you could set me 
o> p with someone on that topic if convenient? As I said I know the basics 


* through our NSC colleagues. 


> Second, ona completely different topic: airline competition and 


S 
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competition and the role that price / fee transparency and search engines 
have in that market. Is there someone we could speak to on the specific 
questions surrounding search and fare transparency (including fee 


transparency), and present any policy views you may have relevant to n& 


topic of auxillary fees, search or closely related topics? ) 


search. As you may know we have a long-standing interest in airline 9) 


Appreciate your help on these topics, 

“© 
Best Tim Y 
Tim Wu ~) 
Special Assistant to the President for Technolgy and Competition 


National Economic Council < 


o 


¢ 


ire « Affairs & Public Policy 


| 
7 ton, DC 20001 


Google Voice 
@google.com 
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Google 


Washington, DC 20001 
soogle Voice 


Director, Govt Affairs & Public Policy oP 


GE 2 co0gle.com 


& 6 ) 
Director, Govt Affairs & Public Policy RS 


Google 


Washington, DC 20001 
Google Voice 


oo < 
gO 


Director, Govt Affairs & Public O 


Google 


Washington, DC 20 


01 ¢ 
GE Giocg!Qoice 


@google.c 
NS 


if 


ireRtor, ovt Affairs & Public Policy 


‘ashington, DC 20001 
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G2 google.com 


Director, Govt Affairs & Public Policy ¢, 


Google 
Washington, DC 20001 ~~ 
EEE Goosic Voice 

GE 2: c00g!c.com 


GE Google Voice L 
O 
WO 


® 


\ 
s 
O 
SS 


> 


Ss 


e 
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Message 
From: SES GE © ¢00¢1¢.com] 4, 


Sent: 6/16/2022 3:34:59 PM 9) 
To: Bernstein, Sonya E. EOP/WHO 0.20 OV 

CG: Kates, Natalie M. EOP/OMB gE @ omb.eop.gov); © googie.co 

Subject: Re: [EXTERNAL] COVID-19 Vaccines for Children Y) 
Thank you, Sonya and Natalie. o> 

That is really helpful to understand. Do you know approximately how compre e under 5 


vaccination sites will be on vaccines.gov, and what proportion of those sites wi open to the 


public? 

& 
Thanks, © 
rH > 


e other sites, including state/local public 


On Thu, Jun 16, 2022 at 9:13 AM Bernstein, Sonya E. EOP/WHO 


GS 2 who. cop.gov> wrote: 


That’s right, primary focus will be providers offices, but there wi 
health sites, hospitals/health systems, and pharmacies. < 


From: Kates, Natalie M. EOP/OMB < 
Sent: Thursday, June 16, 2022 9:10 A 


LOV> 


i <2 00 gle. con?yg Bernstein, Sonya E. EOP/WHO {a 


@who.eop.gzov> 


Subject: Re: [EXTERNAL] COVID-19 edfvesjor Children 


I believe pediatric offices but Sonya, co me if that’s off base. 


Date: Tuesday, June 14, 202 “38 PM 


To: "Kates, Natalie M. E@P ‘TE 01nb.cop.gov> 


@google.com>, "Bernstein, Sonya E. EOP/WHO" {a 


YA®&} COVID-19 Vaccines for Children 


@who.eop. 
Subject: Re: [EXTE 


Okay, wondert® YQ). know if the target of vaccine administration for under 5 will be in the pediatrician 
offices or gent @tations? 


On i S, , 2022 at 5:25 PM Kates, Natalie M. EOP/OMB 4K @omb.cop.gov> wrote: 
‘Oo 
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matically have all the location data @ 
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On Jun 14, 2022, at 5:23 PM, a © coogle.com> wrote: 2) 


Hi Natalie and Sonya, 


Thanks, 


On Tue, Jun 14, 2022 at 5:10 PM Kates, Natalie M. EOP/OMB 


Hey (J. Looping in Sonya who leads our vaccine efforts. C) 


% 
Your colleague J has been working with the vaccines.gov t a 
ready to go. Let me know if there’s more we should talk about. Happy to : t 


Thanks, 
Natalie 


@google.com> 
Date: Tuesday, June 14, 2022 at 2:21 PM 
To: "Kates, Natalie M. EOP/OMB" So 


TE © 20021. com> 
Subject: [EXTERNAL] COVID-19 Vaccines fo dren 


Hi Natalie, XK 


We saw the recent White House an fay that COVID-19 vaccinations of children under 5 


and I believe they are 
e phone. 


From: 


could begin as soon as June 20. vailable for a brief phone call to discuss if there is an 
opportunity to include/ indicate vac@igation sites for this younger age group on Google Search/ 
Maps? 


¢ 


| would be happy to — times for a call. 


Sincerely, i Qy 
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Message 


From: GE @ zoogle.com) 


Sent: 6/16/2022 4:16:12 PM 
To: Hayes, David J. EOP/WHO (gO who.eop.gov]; Rhodes, John B. EOP/WHOS© who.eop.gov] 
cc ES GE 2 :00c!¢ 0) Ocoocle cor]; an 

© coogie.com] 14) 
Subject: YouTube's climate misinformation efforts 


David/John, ge 
We listened to Si interview with Axios last week and noted her call for tech comp ee address climate 
misinformation. We thus thought it might be useful to brief your team on what our Rey team is currently 
doing. For example: 

° Last year, YouTube updated our advertising policies to prohibit ads for, aN@ monetization of, content 
that contradicts well-established scientific consensus around the existence aks causes of climate change. 

° YouTube is also proud to be an industry leader in providing ecaionalcoy corttext through information 
panels that provide viewers important contextual and authoritative info en viewing content on topics 
prone to misinformation, including climate change. These information ill show regardless of what 
opinions or perspectives are expressed in a video. For content relate ate change, YouTube provides 
information from the UN and a link to their climate change a 

e In addition to information panels related to climate chan eck panels are available that provide 
relevant, third-party fact-checked articles above search =e relating to current events. When a 
user enters a query seeking information that relates to a specific Claim for which we have a relevant fact- 
checking article, we may display an info panel at the top Oo lagi results with the title and link to the fact 
check article. 

Let me know when you have time to pull some folks = oO we can dive a bit deeper on this. 


Government Affairs and Public Ro) Manager 
G2 coccle.com 


Best, 


nN 
0 
oe 
o 


cS? 
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Message 


From: @google.com] 

Sent: 8/1/2022 2:21:55 PM 

To: Volin, Lina L. EOP/WHO © who.eop.gov] 

cc: Vogelstein, Rachel B. EOP/NSC (© nsc.cop.cov) Sx (I @coogle com; 
Phadke, Shilpa D. EOP/WHO (gO who.eop.gov] 

Subject: Re: [EXTERNAL] YouTube and Reproductive Health Misinformation 


Attachments: image002.jpg 


Hi Lina, 


S 
oP 


Sure, no problem! Please feel free to send times that work best for your schedule. Iso need you to 
send the calendar invite because I'm not sure the WH can access Google Meet. 


Thanks, C ) 
ay @ Ww 
On Mon, Aug |, 2022 at 9:50 AM Volin, Lina L. EOP/WHO < >> 

Hi all — with sincere apologies for the late notice, could we please ngattp e the meeting this morning and plan 


to reconvene later this week? Q 


Thanks so much, < 


Lina O 
& 


From: Volin, Lina L. EOP/WHO XY 
Sent: Wednesday, July 27, 2022 3:56 PM 

To: @google. 
Ce: Vogelstein, Rachel B. EOP/NSC < 


@google.com>; Phadke, Shilpa). EOP/WHO <q @who.eop.gov> 


Subject: RE: [EXTERNAL] YouTube and Reproductive Health Misinformation 


who.eop.gov> wrote: 


10-10:30 AM ET on Monday ol for us. Thanks! 
Best, & 
Lina Z) 


From: @zoogle.com> 
Sent: Wednesday 


To: Volin, Li or wHO <GR @ who. cop.gov> 


achel B. EOP/NSC < 


Hi Lina, 


816 


HIGHLY CONFIDENTIAL HJC-GOOG-00054696 


One of our team members will actually be attending a White House event at that time and will not be able to 
meet tomorrow. However, we are available to meet next week on 8/1 from 10-1 1am or 8/3 from 9:30-10am, or 
1-1:30pm EST. Please let me know if any of those times work for you. 


Thanks, 
| Y 


D 


On Wed, Jul 27, 2022 at 3:22 PM Volin, Lina L. EOP/WHO <q @who.ecop.gov> Qe 


Hi J -— 10:30-11 AM tomorrow can work for us. Our computers are only able to t@ Zoom; we’re 
happy to supply the link if that’s easier, in which case we’d ask you to please share t ils we should add 
to the invite. Thank you! 


Best, 


Lina « O 


From: @google.com> SO 


Sent: Wednesday, July 27, 2022 9:59 AM 
To: Vogelstein, Rachel B. EOP/NSC 
ce Dgoogle.com>; Phadke, 
(@who.eop.gov>; Volin, Lina L. EOP/W 

Subject: Re: [EXTERNAL] YouTube and Raps a 


Hi Rachel, x 


~ 


Our team is available to meet tomorrow, 7/ me from 10-11am EST. Please let me know if this time 
works for you and I will send out a cale te. 


a D. EOP/WHO 
@who.eop.gov> 
Misinformation 


_ a 
Nj 


@ 
On Tue, Jul 26, 2022 at 10:020RNA Vogelstein, Rachel B. EOP/NSC {RE @ nsc.cop.gov> 


wrote: 
, thank you. W ecifically interested in abortion, but we’re very glad to better understand your 
policies more gene 


& 
If you can pro Ye windows that might work Thursday and Friday, we can lock down a time from 
there. 


Thang. eng, 
Rache 
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From: @google.com> 

Sent: Tuesday, July 26, 2022 11:04 AM 

To: Vogelstein, Rachel B. EOP/NSC @nsc.eop.gov> 

Ce: @google.com>; Phadke, Shilpa D. EOP/WHO 


(@who.eop.gov>; Volin, Lina L. EOP/WHO <I @who.eop.gov> 


Subject: Re: [EXTERNAL] YouTube and Reproductive Health Misinformation Y 


Hi Rachel, Ry 


Our team would be happy to meet and discuss our data privacy and ad policies. For eeting, would you 
like us to discuss our ad policies more generally or specifically related to we; 
Thanks, 


On Thu, Jul 21, 2022 at 5:13 PM Vogelstein, Rachel B. EOP/NSC .cOp.gov> 
wrote: 


Thanks jj. We'd like to understand more about data p y atid ad policies. Perhaps Monday 
between | and 2:30? 


Thank you. ‘@) 
Sent: Thursday, July 21, 2022 3:05 PM 


To: Vogelstein, Rachel B. EOP/NSC < 
CC iii il p emom>; Phadke, Shilpa D. EOP/WHO 
@who.eop.gov>; Volif Lina L. EOP/WHO <q who.eop.gov> 


Subject: Re: [EXTERNAL] YouTubegnd Reproductive Health Misinformation 


Hi Rachel, ‘ i 
N 


Nice to meet you! I oe office tomorrow, but will be back next week. Please feel free to send 


@Nsc.eop.gov> 


specific questions yo like me to cover.Also, please send dates/times that work best for you. 


Thanks, wO 
On on , 2022 at 2:59 PM Vogelstein, Rachel B. EOP/NSC <q @nsc.cop.gov> 


wrole: 
| ank you. 


GB. if you have 20 minutes for a quick call tomorrow, let us know—perhaps between 12:00 — 1:30? 
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Thanks, 
Rachel 


Sent: Thursday, July 21, 2022 2:28 PM ) 
To: Vogelstein, Rachel B. EOP/NSC @nsc.eop.gov> 

Ce: Phadke, Shilpa D. EOP/WHO <I @ who.eop.gov>; Volin, Lina L. Eda yri 
GES © 10.cop.gov>; Rachel Gruner <E@ soogle.com> 


Subject: Re: [EXTERNAL] YouTube and Reproductive Health Misinformation NS 


e) 


Last email of the day; but connecting you here with Goo et lead, who can address 
bo?ajon. 


some of your questions regarding data privacy, and ads policies regarding a 


On Thu, Jul 21, 2022 at 2:04 PM Vogelstein, Rachel B. EOP/NSC < 
wrote: 


Thank you—appreciate it. ~> 


From: @google.com> 
Sent: Thursday, July 21, 2022 1:45 PM 
To: Vogelstein, Rachel B. EOP/NSC 
Ce: Phadke, Shilpa D. EOP/WHO < *Wvho.ecop.gov>; Volin, Lina L. EOP/WHO 

@who.eop.gov> 
Subject: Re: [EXTERNAL] YouTube and roductive Health Misinformation 


Blog post referenced by Jess on Google : fu, to connect you to the right folks at Google if you 
want to follow up: 


¢ 


https://blog. google/technolog fety-security/protecting- 


2 
On Tue, Jul 19, 2022 at A ‘TE @ 200g le.com> wrote: 


sorry to be a pain, bugahyou add the following two people from our side? 


L@) Jul 19, 2022 at 8:40 PM aS - @ coogle.com> wrote: 


Perfect, let's do Thursday at 1:30pm? Do you all want to send around a zoom link or we can send 
around GVC. 
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On Tue, Jul 19, 2022 at 6:21 PM Vogelstein, Rachel B. EOP/NSC 


@nsc.eop.gov> wrote: 


Thanks [how about 1:30 or 3 PM on Thursday afternoon? 


From: TE <I O 2002\e com> Y 
Sent: Monday, July 18, 2022 8:16 PM %) 
To: Vogelstein, Rachel B. EOP/NSC <I @nsc.cop.gov> Qe 


Ce: Phadke, Shilpa D. EOP/WHO <q @ who.eop.gov>; Volin, Lina L {WHO 


@who.eop.gov> g) 
Subject: Re: [EXTERNAL] YouTube and Reproductive Health Misinformatio 


Hi Rachel, gR 


Sincere apologies for the delay in responding. Happy to connect Ne k; would Thursday afternoon 
EST or any time Friday work? 


Many thanks, 


Error! Filenanic not specified, ) 


Manager, YouTube Government Affairs a ublic Policy 


oogle.com ~ O 


¢ 
0 


On Jul 14, 2022, at 1:38 PM, Vogelstein, Rachel B. EOP/NSC I @nsc.cop.gov> 


wrote: 
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WB. thanks very much. We'd love to learn more—looping GPC colleagues. Glad to join the DPC 
briefing—perhaps you can share your contact there and we can coordinate internally? 


Thanks and looking forward— 


Best, & 
Rachel Ry 
From: @google.com> N 

Sent: Thursday, July 14, 2022 1:16 PM Y) 

To: Vogelstein, Rachel B. EOP/NSC @nsc.eo 

Ce: @google.com> 


Subject: [EXTERNAL] YouTube and Reproductive Health Misinf Cy 


SS 


Hi Rachel, SO 
| hope this note finds you and your team doing cornea We know you all are 


inundated but wanted to flag that we are about t ounce some updates related to 


addressing reproductive health meri Tube 

We would be happy to preview the upda s Gry 4 and/or your team. Of course, no 
pressure given all you have on your pl Gye wanted to flag for you and make you 
aware that we are also briefing HHS, x on aaa DPC and other entities within the 
USG. 

Many thanks, <S 

Error! FHename nat specified. ? 


~~ 


Manager, a aia Affairs and Public Policy 


€.com 


> 


© 
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Message 
From: SEES GE © <002'e.com] 5 


Sent: 8/3/2022 11:18:18 PM %) 
To: SEE © £00¢!<.com) 

Subject: Fwd: [EXTERNAL] [Follow up items] Thanks for meeting 

FYI NS 


¢ Prasident, Americas & Glob artners 


PP pe om iw t a 
OOCIG LLC & 


: B® coogie. com Y 


---------- Forwarded message --------- 
From: Flaherty, Rob R. EOP/WHO < 
Date: Wed, Aug 3, 2022 at 7:19 PM 
Subject: RE: [EXTERNAL] [Follow up items] Thanks for meds 


| iii @google.com> 
Ge — Thanks, and likewise. I know Mike also YY d the conversation. And jj, hello! Looking 


forward to catching up. 


From: i EO 202K: 
Sent: Wednesday, August 3, 2022 1:05 
To: Flaherty, Rob R. EOP/WHO 
Ce: 
Subject: [EXTERNAL] [Follo 


® 
Hi Rob, LO 
It was a pleasure mé@ting*with you last week. | enjoyed our conversation and appreciated your ideas 
and thoughtful q around how Google platforms can help inform and educate voters. 


| wanted ro with a few thoughts on the questions you raised — see below. | would also 


@google.com> 


ns] Thanks for meeting 


encoura oO meet with the Left-of-Center elections team, led by MM. to dive deeper (| 
believe know each other). J will reach out to set up time. 


One B ad ain, thank you for the discussion and the time. Please don’t hesitate to reach out with other 
questfefis or ideas. 
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Best, Y) 
= 2 
e MaxLift replacement Oy 


° Background: 

. Google (as a whole, not just for elections) elected to deprecate M arlier 
this year. 

° Recommendation: 

. Brand Lift remains a powerful tool to help measure camp tiveness, and 
we recommend using Brand Lift measurement for all of your YouTube campai 

" Before deprecation, we also ran a number of experiments to identify improved 


alternatives. In lieu of Max Lift, we recommend leveraging TrueView In-Stréamand our new Target 
Frequency (Beta) formats. Similar to Max Lift, these products rely on ta achine Learning 
technology, and global data has shown they produce similar consicorstag? while outperforming 
Max Lift on secondary goals, like frequency and watchtime. 


= We are continuing to focus our efforts on dev ore scalable consideration 
and mid-funnel video product solutions Me 

° Shorts 

fo) Monetization: YouTube is currently experim with Shorts monetization, showing 
ads on a very small amount of traffic with direct response fo . This experiment is in its Alpha 
stage and features a closed group of advertisers. We willfet you know as these experiments expand 
so that you can benefit from the results and participat 

e Emerging Trends and Topics C) 

° Background: As you mentioned, cgéatiye tkémes and interest volume changes with the 


pace of the newscycle. To manage relevant con themes and opportunities, the team has 
operationalized two reports that rely on search inter@st data and prevalent advertising themes. Sarah 
will continue the discussion on each of rose follow up. 

e News Lab’s public trends data, these are 


- Google Trends Repo 
category specific insights driven by = across YouTube and Google Search 


Competitive re urced from our public Transparency Report and 


Creative Repository, we summarize h creative themes are driving performance investment from 
top advertisers 


~ 


s 
° ae a & Global Partners 


on median 3 f eS 
* Google LLS 


* oogle.com 
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From: [/O=AMAZON/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN 

Sent: 3/5/2021 9:54:09 AM 

To: @amazon.com); GEE amazon.com) 

cc: Ee © amazon.com] 

Subject: RE: [EXTERNAL] Re: Re: Following Up 


Thanks, MBB. (il pass this along to the scheduler. 


From: ies © amazon.com> 
Sent: Friday, March 5, 2021 12:32 PM 


To: © amazon.com>; i < © a mazon.com> 
Cc: EE © am azon.com> 


Subject: RE: [EXTERNAL] Re: Re: Following Up 
Tharitcs I 
Let’s go with: i iy 


We will jet IJ serve as proxy for the business. 


From: © a.2200.com> 

Sent: Friday, March 5, 2021 12:19 PM 

= ee an 
Cc: EE © 2: 2200.com> _ com> 


eiMere RE: [EXTERNAL] Re: Re: Following Up 


Yes, the scheduler just now confirmed it’s Andy Slavitt. 
CHE, tpoughts on the attendee list, particularly if we want to invite someone from the business? 


From: 2 2) 2200.corm> 


Sent: Friday, March 5, 2021 11:58 AM 


Sie Re: [EXTERNAL] Re: Re: Following Up 


By Andrew, we mean Andy Slavitt | assume? He’s the leader so |’d say me, EE and then 
if we want one more person from the business, that’s also ok. I’m ok with going a bit larger if Andy will be 
there. 


On Mar 5, 2021, at 11:09 AM, i © = 


Meeting will be 1.30-2pm ET Tuesday 3/9. WH attendees are Rob and Andrew. 
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Who will the Amazon attendees be? {ll need to send their emails to the scheduler. 


From: as 


Sent: Thursday, March 4, 2021 6: 04 PM 


‘>; EE @ 212z00.com> 


Subject: RE: [EXTERNAL] Re: Re: Following Up 


Thanks for that color. Sounds geod. 


From: iii Mamazon.com> 


Subject: Re: [EXTERNAL] Re: Re: Following Up 


It’s ok. This is up to them. If they’re not in a hurry, we’re not. 


On Mar 4, 2021, at 6:01 PV x © amazon.com> wrote: 


No word yet from the scheduler. Will follow up mid morning. 


From: ne © amazon.com> 

Sent: Thursday, March 4, 2021 2:08 PM 

To: i (EE ® 2: 220n.com> 

Cc: i 22> >; RE © 222z00.com> 


Subject: Re: [EXTERNAL] Re: Re: Following Up 


No further update beyond last nights. 


| included Bon a response. I'd say let’s shoot for Tuesday. We should keep it to 30 minutes. From our end, we’d 


definitely have me, I. We may add I or others depending on who they have from their side. 
MB, When you’re scheduling this, can you see whether they envision just Robert (WH digital director) or others? 


MM, can you keep this thread updated in real-time? We need to push the business to do some things that will depend 
on the timing. 
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HE in parallel, | am meeting with Jay at 2:30 pm. Any update on business discussions before then? 


From: "Qureshi, Hoor EOP/WHO" <a w p.gov> 

Date: Thursday, March 4, 2021 at 12:00 PM 

To: "Flaherty, Robert EOP/WHO" <i who.cop.cov>, iy 
< ® 2:1 22010.com>, "Slavitt, Andrew M. EOP/WHO" <q w ho.cop.gov>, 
"Butterworth, Zach Z. EOP/WHO" << o . 

Cc: "Wakana, Benjamin L. EOP/WHO" < 
Subject: RE: [EXTERNAL] Re: Re: Following Up 


@who.eop.gov> 


: 


"CAUTION: : This sania oneuaied t from a cutsids asco ceatarion: Do not Ht click: taker or open caiechaae 
| unless sf dies can pcone Lea pica ae anid basis content is cele 


_ 


Happy to help get this scheduled! Any chance you could send over some times that work well on your end for early next 
week? 


Thanks, 
Hoor 


From: Flaherty, Robert EOP/WHO 

Sent: Tuesday, March 2, 2021 6:16 PM 

To: i n>; Slavitt, Andrew M. EOP/WHO 
Butterworth, Zach Z. EOP/WHO < (i winc.cop.gov> 

Cc: Wakana, Benjamin L. EOP/WHO <q © wino.cop.gov>; Qureshi, Hoor EOP/ WHO 
<e wii'c.cop.zov> 


Subject: RE: Re: Re: Following Up 
Hi 


Thanks. Let’s talk about what your policies are. Want to understand what the lines are here. My colleague Hoor can help 
find us all a time. 


OP.£OV>, 


-Rob 


From: i (EE © 20 220n.com> 

Sent: Tuesday, March 2, 2021 3:21 PM 

To: Slavitt, Andrew M. EOP/WHO <SEEEEEEE © wn eo. g0v>; Butterworth, Zach Z. EOP/WHO 
<2 0.c0. 20>; Flaherty, Robert EOP/WHO <I who cop.gov> 

Cc: Wakana, Benjamin L. EOP/WHO <q @ who cop.gov> 

Subject: [EXTERNAL] Re: Re: Re: Following Up 


We’d be happy to talk and can discuss any specific examples like what you shared, and also your thoughts more 
generally. Robert, can we set up time this week? 


Thanks, 
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From: "Slavitt, Andrew M. EOP/WHO" <§O w hc.cop.gov> 

Date: Tuesday, March 2, 2021 at 3:14 PM 

To: "Butterworth, Zach Z. EOP/WHO" <i /ho.coo.cov>, im 
<n 2z0n.com>, "Flaherty, Robert EOP/WHO" < @who.eop.gov> 
Cc: "Wakana, Benjamin L. EOP/WHO" <i, 9) wino.cop.zov> 

Subject: RE: [EXTERNAL] Re: Re: Following Up 


_pieneresanneasnnnseanneasansossannnanannnasanonsasannsssannasainnnsaantosdannnssdnnnsadsennassannsssennsssinansnanansdssnanssaerinssdanrosdannsssennnseannnananacsssnnsassennessannssnananssanenssannnssansnesannnsacennessanreadsannnssannnssdnnnsasannnasannsssennsanannonsanrnsnannnssanerssnnnnssey mrecserconmarecsenecenaneesceey 


CAUTION: This email originated from outside of the organization. Do not click links or open attachments 
unless you can confirm the sender and know the content is safe. 


Fawanrowravonennsonenneen 


preremernrnaneneennnenne 


In fact right above it is the line “Vaccines are dangerous and don’t work” promoting even another book. The site caters 
to people who are anti-vax. 


We would welcome spending time on this with you—not just about policies, but examples like this that are of concern. 
And in my opinion, even a CDC warning wouldn’t be a great solution. 


From: Butterworth, Zach Z. EOP/WHO 

Sent: Tuesday, March 2, 2021 2:53 PM 

To: i GE ® 22:.5207.com>; Flaherty, Robert EOP/WHO <§EEEEEEEE who .cop.gov>; Slavitt, 
Andrew M. EOP/WHO <q who.e 

Cc: Wakana, Benjamin L. EOP/WHO 
Subject: RE: Re: Re: Following Up 


who,eop.gov> 


i, Thanks for your response. Five minutes ago | searched ‘vaccine’ on Amazon and the attached book was one of 
the first in the stack. When | click on the product page | don’t see any CDC warning. Zach 


<image001 .jpg> 


From: GE © 8 2200.com> 


Sent: Tuesday, March 2, 2021 2:44 PM 


<R ® 30.cop.20v> 
Cc: Butterworth, Zach Z. EOP/WHO < whso.ecop.gov>; Wakana, Benjamin L. EOP/WHO 
2.80¥> 


Subject: [EXTERNAL] Re: Re: Re: Following Up 


Hi, Robert. Let me know if you want to chat in more detail. But to give you an overview, we have content guidelines and 
remove products that do not adhere to these policies-- which can be found here for books. Specifically, we not allow 
content meant to mislead customers or that doesn’t accurately represent the content of the book. 


You'll see when you search for books related to vaccines or the coronavirus that we have a clear signpost at the top of 
the search page that links to the CDC page on vaccine information. Additionally, when you click on a particular book to 
look at the product detail page, we again direct customers to the CDC information in a bright bold box up top. So we’re 
surfacing CDC information again for every customer, right at the top of the page. 


We invest significant time and resources to enforce our content guidelines. And we use a combination of machine 
learning, automation, and dedicated teams of human reviewers. If there is content that you think misleads customers on 
vaccines, please let us know. 
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Robert, if we can follow up in more depth with you or answer any specific questions, I’ll make the team available at your 
convenience. As you know, we very much want to help you get Americans vaccinated. That’s our goal. 


Thanks, 


ert) Vice President, Public Policy | Amazon 


From: "Slavitt, Andrew M. EOP/WHO" < @who.eop.gov> 


Date: Tuesday, March 2, 2021 at 8:48 AM 

Cc: "Butterworth, Zach Z. EOP/WHO" <I who.cop.gov>, "Wakana, Benjamin L. EOP/WHO" 
<2) 2.20p.gov>, “Flaherty, Robert EOP/WHO" < @who.eop.gov> 
Subject: RE: [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


CAUTION: This email originated from outside of the organization. Do not click links or open attachments 
_ unless you can confirm the sender and know the content is safe. 


yw 
é 
= 
3 
i 
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If you search for “vaccines” under books, | see what comes up. | haven’t looked beyond that but if that’s 
what’s on the surface, it’s concerning. 


Happy to get briefed but want to understand the data when we do. |’m roping in Robert as well. 


Thanks. 


Sent from my iPhone 


Hi. ’m happy to talk to you all to learn more, We’ve taken a number of actions to not show misleading content 
on vaccinations so if we’re missing something, please let us know. We can also doa more fulsome briefing 
with our content teams if that’s helpful. 


I’m available at the number below whenever you want to chat or we can schedule if that’s better Thanks, 


On Mar 2, 2021, at 7:33 AM, Slavitt, Andrew M. EOP/WHO <{e wo.cop.gov> wrote: 
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CAUTION: This email originated from outside of the organization. Do not click links or open attachments 
unless you can confirm the sender and know the content is safe. 


| 


Who can we talk to about the high levels of propaganda and misinformation and disinformation of Amazon? 


Sent from my iPhone 


Also, just a heads up that we’ve begun our internal messaging campaign to encourage our workers to get vaccinated. 
Our Amazon Pharmacy employees in Arizona were among the first to be vaccinated recently, and we put together this 
video with employee testimonials and footage showing how easy the whole process is. We’re pushing this through all of 
our internal employee comms channels, and we’ll continue to do more as vaccinations expand. Our data indicates that 
messaging about vaccination from fellow employees will be an effective driver, which is why we’ve done this. 


>>>>https://www.aboutamazon.com/news/workplace/getting-vaccinated-what-it-means-for-amazon-heaithcare- 


workers<<<<)5; 


2.8. 
From: ee <M © 2 8.2200.com> 


Date: Monday, February 22, 2021 at 10:06 AM 

To: "Butterworth, Zach Z. EOP/WHO" <I who.cop.gov>, "Wakana, Benjamin L. EOP/WHO" 
‘TE 2 1220p zov> 

Cc: "Slavitt, Andrew M. EOP/WHO" <I who.ecop.gov> 

Subject: Re: [EXTERNAL] Following Up 


Thanks, Zach. | checked with the AWS team over the weekend and they’re in discussions with Virginia and several other 
states about how they can help. One AWS product is of interest to several states, Amazon Connect, 
>>>>https://aws.amazon.com/connect/<<<<;;;, which can help quickly scale up customer/citizen service contacts. 


Also, | wanted to let you know what we've been following up extensively with Ohio, both at the state level and with 
several county governments. We’ve got several things potentially in the works. For example, we have an executive now 
serving on the state Vaccine Project Logistics Committee, we will likely be providing employee volunteers to some 
events in Columbus, and we may be offering some of our facility parking lots for clinics in Lucas County. We’ve made 
contact throughout the state and there will likely be some other collaborations soon. 


Please keep forwarding us things — we’re happy to help anywhere and anyhow. 


From: "Butterworth, Zach Z. EOP/WHO" <i wiio.cop.gov> 
Date: Friday, February 19, 2021 at 6:08 PM 


To: i EE © 2 -.2200.com>, "Wakana, Benjamin L. EOP/WHO" 
Cc: "Slavitt, Andrew M. EOP/WHO" <Q @ who. cop.gov> 


Subject: [EXTERNAL] Following Up 
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CAUTION: This email originated from outside of the organization. Do not click links or open attachments 


unless you can confirm the sender and know the content is safe. 


GE | spoke with Andy today and we wanted to flag the article below. The last paragraph mentions 
Virginia’s success in getting providers to release doses by having a public portal that shows who has the vials 


and the percent administered. If you all are working with states, this may be a worthwhile area for effort. 
Many thanks, Zach 
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From: ME [ /©=AIVAZON/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN- | 


Sent: 3/2/2021 12:26:06 PM 
To: EE G2 20122000); IO 2320n.com] 
Subject: RE: [EXTERNAL] Re: Re: Following Up 


Agree, will do asap. 


From: TS IES 2raz0n.com> 
Sent: Tuesday, March 2, 2021 3:22 PM 


To: TT am.azon.com>; EEE © amazon.com> 
Subject: FW: [EXTERNAL] Re: Re: Following Up 


See below. They also pointed to the Kindle ad up at the top, which is disturbing. 


We need to get a SWAT team together and prepare a briefing later this week. Let’s discuss. 


From: i < @amazon.com> 


Date: Tuesday, March 2, 2021 at 3:20 PM 

To: "Slavitt, Andrew M. EOP/WHO" <i ws hbo.cop.gov>, "Butterworth, Zach Z. EOP/WHO" 
<( © 2.200.20v>, “Flaherty, Robert EOP/WHO" <N who.cop.gov> 

Cc: "Wakana, Benjamin L. EOP/WHO" <q © who.cop.gov> 

Subject: Re: [EXTERNAL] Re: Re: Following Up 


We’d be happy to talk and can discuss any specific examples like what you shared, and also your thoughts more 
generally. Robert, can we set up time this week? 


Thanks, 


From: "Slavitt, Andrew M. EOP/WHO" <q wo .cop.cov> 

Date: Tuesday, March 2, 2021 at 3:14 PM 

To: "Butterworth, Zach Z. EOP/WHO" <9 who.cop.cov>, 
@amazon.com>, "Flaherty, Robert EOP/WHO" <_E® wo. cop.gov> 

Cc: "Wakana, Benjamin L. EOP/WHO" < @who.eop.gov 

Subject: RE: [EXTERNAL] Re: Re: Following Up 


pre eAMrneaann en ined Aline Aaa er aA ter PIMP E BAA PCLMB OL AMMEE TABOR AAANCEMANAEENE BAC CMIAOE BAAR ARE EEAEAAE CANAL RIE REMAN HAMEL PEACE ED MALETEABAAE EE ACEENDALCCEARN EEE ADAOE AMIEL AAI ECANCEMANCEECHEBIE RE MAACO MANOEEAEMML CAC EOOBEC EMMI OCHASE CED BOP CODA CEMAIEEE LANCIA EBCEE BAL OMBLECE AIOE EADIE CEEMOCCERAEOCER ASAE ALOE CENA AOCE SANE EME NCE CAAOC NAC 


CAUTION: This email originated from outside of the organization. Do not click links or open attachments 
_ unless you can confirm the sender and know the content is safe. 


In fact right above it is the line “Vaccines are dangerous and don’t work” promoting even another book. The site caters 
to people who are anti-vax. 


We would welcome spending time on this with you—not just about policies, but examples like this that are of concern. 
And in my opinion, even a CDC warning wouldn't be a great solution. 


From: Butterworth, Zach Z. EOP/WHO 
Sent: Tuesday, March 2, 2021 2:53 PM 
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To: <2) 320.com>; Flaherty, Robert EOP/WHO <§EE©® who.cop.gov>; Slavitt, 
Andrew M. EOP/WHO <_q © »p.gOVv> 

Cc: Wakana, Benjamin L. EOP/WHO <Q wn o.cop.gov> 

Subject: RE: Re: Re: Following Up 


fey — Thanks for your response. Five minutes ago | searched ‘vaccine’ on Amazon and the attached book was one of 
the first in the stack. When | click on the product page | don’t see any CDC warning. Zach 


Alexandria 22° xe * me + 6Aecount & Lists « irders 
© alexandria 22301 Hie yaccing & BL & Ord 


bas Ail Prime Viden Austin’s Amazon.com: TV & Video: Guy Again Prime + — Customer Service - Best Sellers Browsing History Get your hom! 


fogks AdveancetSeartt New heleasss  BerSellecs eh Mere Chitdraers Mocks Textbooks  Tavthmck Rental Sect B 


audible” 


VWaeccistes Are Bangersus » Aad Gan't Work and millions of ather backs are available for Amazon Kindle. Le 


t PROT E 


Anyone Who Tells You Vaccines Are Safe . 


Lama insite 3 surtinitied 


and Effective is Lying Paperback ~ March ES aa aa 


membership, 


27, — 


Buy new: 


Jprime 


Li i. . FREE delivery; Thursday, Mai 
Oesfor within $$ thes ave 144 
Datais 
in Stack, 


AS an alternative, the Riedie: 
The tacks abou vaovination ~ xo that you can make up your own mind. Oe Vernon is avaiable now and can ber 
Oolemen MB Crs OSc FRSA has been sesearching and writing abou! vaccines ior any device with the tree ind 
50 yeets, He tes inchuredd doctors and curses on Bie sublect. He used to debate Cees 
Wandciimtion on TY anc radia out won every public details and thea dave vaccine 


supporters will no longer debate with hire ; if 
ae tartare co 


@amazon.corr> 

Sent: Tuesday, March 2, 2021 2:44 PM 

To: Flaherty, Robert EOP/WHO qq ® who.cop.gov>; Slavitt, Andrew M. EOP/WHO 
<M 2 2.0. gov> 

Cc: Butterworth, Zach Z. EOP/WHO <q winc. 
Q@who.eop.gov> 

sibeces [EXTERNAL] Re: Re: Re: Following Up 


Hi, Robert. Let me know if you want to chat in more detail. But to give you an overview, we have content guidelines and 
remove products that do not adhere to these policies-- which can be found here for books. Specifically, we not allow 
content meant to mislead customers or that doesn’t accurately represent the content of the book. 


You'll see when you search for books related to vaccines or the coronavirus that we have a clear signpost at the top of 
the search page that links to the CDC page on vaccine information. Additionally, when you click on a particular book to 
look at the product detail page, we again direct customers to the CDC information in a bright bold box up top. So we’re 
surfacing CDC information again for every customer, right at the top of the page. 
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We invest significant time and resources to enforce our content guidelines. And we use a combination of machine 
learning, automation, and dedicated teams of human reviewers. If there is content that you think misleads customers on 
vaccines, please let us know. 


Robert, if we can follow up in more depth with you or answer any specific questions, |’ll make the team available at your 
convenience. As you know, we very much want to help you get Americans vaccinated. That’s our goal. 


Thanks, 


a Vice President, Public roy | Amazon 


From: "Slavitt, Andrew M. EOP/WHO" <I who.cop.gov> 
Date: Tuesday, March 2, 2021 at 8:48 AM 
To: 


@Mamazon.com> 


<BR ® 3.200. cov>, “Flaherty, Robert EOP/WHO" pt 


Subject: RE: [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


If you search for “vaccines” under books, | see what comes up. | haven’t looked beyond that but if that’s 
what’s on the surface, it’s concerning. 


Happy to get briefed but want to understand the data when we do. I’m roping in Robert as well. 


Thanks. 


Sent from my iPhone 


On Mar 2, 2021, at 8:36 AM, @amazon.com> wrote: 


Hi. I’m happy to talk to you all to learn more, We’ve taken a number of actions to not show misleading content 
on vaccinations so if we’re missing something, please let us know. We can also do a more fulsome briefing 
with our content teams if that’s helpful. 


I’m available at the number below whenever you want to chat or we can schedule if that’s better Thanks, 
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On Mar 2, 2021, at 7:33 AM, Slavitt, Andrew M. EOP/WHO <Q® who.cop.gov> wrote: 


CAUTION: This email originated from outside of the organization. Do not click links or open attachments 
unless you can confirm the sender and know the content is safe. } 


ARE EENDRAA APIA LOPE ISL LEEI SPE EE SSE PERS SE PODS ILE ERSE SE PEBS EP PEII SE PEISSELPRS BL EERE SEPDES SEEPOS SIP PPS SBOP APE SLEEPERS SPELL IEE PPI I LPLLIE LEP PLEIPPERS SEPA I SEL LPS SELLY ISIE P ES LEPE ELI SPOOL IELER IEP L PALES SEP EOI ILPPORLIEPEB I SEPEB I APPS ESLPPI SLE PPCEY PEP PISLLPBE SPEED SSPE LE PLEOI ISCAS ISELIN PAS 


' 
: 
i 


Who can we talk to about the high levels of propaganda and misinformation and disinformation of Amazon? 


Sent from my iPhone 


On Feb 25, 2021, at 1:40 PM, 2 2 22200.com> wrote: 


Also, just a heads up that we've begun our internal messaging campaign to encourage our workers to get vaccinated. 
Our Amazon Pharmacy employees in Arizona were among the first to be vaccinated recently, and we put together this 
video with employee testimonials and footage showing how easy the whole process is. We’re pushing this through all of 
our internal employee comms channels, and we'll continue to do more as vaccinations expand. Our data indicates that 
messaging about vaccination from fellow employees will be an effective driver, which is why we’ve done this. 


>>>https://www.aboutamazon.com/news/workplace/getting-vaccinated-what-it-means-for-amazon-healthcare- 


From: nn <M ® 2:azon.com> 

Date: Monday, February 22, 2021 at 10:06 AM 

To: "Butterworth, Zach Z. EOP/WHO" <i n© who.cop.gov>, "Wakana, Benjamin L. EOP/WHO" 
Cc: "Slavitt, Andrew M. EOP/WHO" <I wh o.cop.gov> 

Subject: Re: [EXTERNAL] Following Up 


Thanks, Zach. | checked with the AWS team over the weekend and they’re in discussions with Virginia and several other 
states about how they can help. One AWS product is of interest to several states, Amazon Connect, 
>>>https://aws.amazon.com/connect/<<<);, which can help quickly scale up customer/citizen service contacts. 


Also, | wanted to let you know what we’ve been following up extensively with Ohio, both at the state level and with 
several county governments. We’ve got several things potentially in the works. For example, we have an executive now 
serving on the state Vaccine Project Logistics Committee, we will likely be providing employee volunteers to some 
events in Columbus, and we may be offering some of our facility parking lots for clinics in Lucas County. We’ve made 
contact throughout the state and there will likely be some other collaborations soon. 


Please keep forwarding us things — we’re happy to help anywhere and anyhow. 


From: “Butterworth, Zach Z. EOP/WHO" <i who.cop.gov> 

Date: Friday, February 19, 2021 at 6:08 PM 

To: ES < © 2 2200.com>, "Wakana, Benjamin L. EOP/WHO" 
< © 2.220 c0r> 


Cc: "Slavitt, Andrew M. EOP/WHO" <I who. cop.gov> 
Subject: [EXTERNAL] Following Up 
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CAUTION: This email originated from outside of the organization. Do not click links or open attachments 


unless you can confirm the sender and know the content is safe. 


Pont - | spoke with Andy today and we wanted to flag the article below. The last paragraph mentions 
Virginia’s success in getting providers to release doses by having a public portal that shows who has the vials 


and the percent administered. If you all are working with states, this may be a worthwhile area for effort. 
Many thanks, Zach 


>>>https /Avww. nytines conv202 1/02/1 Gfus/coronavirus-vaccines hhni7referringSource=articleShare<<< 
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From: [/O=AMAZON/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN=BHUSEMAN] 

Sent: 3/2/2021 11:46:10 AM 

To: amazon.com); i © amazon.com] 

Subject: FW: [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


Here is what | sent. | tried to make it more conversational, less formal. 


Now, we should alert the business that we have WH attention on this issue. | think we should send an email recapping 
again to the business team, and | want it to be an email that | can forward to Dave, Russ, Jay, Drew, David, Naggar, etc. 
So let’s draft something with that in mind. | want to escalate that I’m being questioned about this. We should use in our 
message to the business team some of Andy’s language below. 


From: EE 2 a. az0n.com> 

Date: Tuesday, March 2, 2021 at 2:44 PM 

To: "Flaherty, Robert EOP/WHO" <M who.eop.gov>, "Slavitt, Andrew M. EOP/WHO" 

< @who.eop.gov> 

Cc: "Butterworth, Zach Z. EOP/WHO" < who.eop.gov>, "Wakana, Benjamin L. EOP/WHO" 


TEE ® 0.20 .gov> 


Subject: Re: [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


Hi, Robert. Let me know if you want to chat in more detail. But to give you an overview, we have content guidelines and 
remove products that do not adhere to these policies-- which can be found here for books. Specifically, we not allow 
content meant to mislead customers or that doesn’t accurately represent the content of the book. 


You'll see when you search for books related to vaccines or the coronavirus that we have a clear signpost at the top of 

the search page that links to the CDC page on vaccine information. Additionally, when you click on a particular book to 

look at the product detail page, we again direct customers to the CDC information in a bright bold box up top, So we’re 
surfacing CDC information again for every customer, right at the top of the page. 


We invest significant time and resources to enforce our content guidelines. And we use a combination of machine 
learning, automation, and dedicated teams of human reviewers. If there is content that you think misleads customers on 
vaccines, please let us know. 


Robert, if we can follow up in more depth with you or answer any specific questions, I'll make the team available at your 
convenience. As you know, we very much want to help you get Americans vaccinated. That's our goal. 


Thanks, 


a * Vice President, Public ea } Am 


From: "Slavitt, Andrew M. EOP/WHO" <i who.eop.gov> 
Date: Tuesday, March 2, 2021 at 8:48 AM 


To: ES EES amazon.com> 
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Cc: "Butterworth, Zach Z. EOP/WHO" <i who.eop.gov>, "Wakana, Benjamin L. EOP/WHO" 


<2 ws). 0.c0p.gov>, “Flaherty, Robert EOP/WHO" <fO who.eop.gov> 


Subject: RE: [EXTERNAL] [EXTERNAL] Re: Re: Following Up 


ms peer sais art casi aaM sia 
"CAUTION: : This oneal oddinated cit fi ouiiiile ae 8-6 organization. Do not ‘click | — or open enn 
_unless Saleh can omen irm nee ness ese oni been content is ecco 


crhmanenennennnneey 


ARIDIINLELON ELIE 


If you search for “vaccines” under books, | see what comes up. | haven’t looked beyond that but if that’s 
what’s on the surface, it’s concerning. 


Happy to get briefed but want to understand the data when we do. |’m roping in Robert as well. 


Thanks. 


Sent from my iPhone 


On Mar 2, 2021, at 8:36 AM, ES <I a mazon.com> wrote: 


Hi. I’m happy to talk to you all to learn more. We’ve taken a number of actions to not show misleading content 
on vaccinations so if we’re missing something, please let us know. We can also do a more fulsome briefing 
with our content teams if that’s helpful. 


\’m available at the number below whenever you want to chat or we can schedule if that’s better Thanks, 


On Mar 2, 2021, at 7:33 AM, Slavitt, Andrew M. EOP/WHO <O who.eop.gov> wrote: 


“CAUTION: : This manil oxisinated’fe ‘cum iis of f the organization. 1. Don not tolick links 0 or open sithedraats 
— you can confirm the sender and know the content is safe. 


Who can we talk to about the high levels of propaganda and misinformation and disinformation of Amazon? 


Sent from my iPhone 


On Feb 25, 2021, at 1:40 PM, i EO amazon.com> wrote: 


Also, just a heads up that we’ve begun our internal messaging campaign to encourage our workers to get vaccinated. 
Our Amazon Pharmacy employees in Arizona were among the first to be vaccinated recently, and we put together this 
video with employee testimonials and footage showing how easy the whole process is. We’re pushing this through all of 
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our internal employee comms channels, and we’ll continue to do more as vaccinations expand. Our data indicates that 
messaging about vaccination from fellow employees will be an effective driver, which is why we’ve done this. 


wor meni 


From: TS EEE amazon.com 


Date: Monday, February 22, 2021 at 10:06 AM 

To: "Butterworth, Zach Z. EOP/WHO" <I who.eop.gov>, "Wakana, Benjamin L. EOP/WHO" 
TEE 1 10.e0.gov> 

Cc: "Slavitt, Andrew M. EOP/WHO" <{BO who.eop.gov> 


Subject: Re: [EXTERNAL] Following Up 


Thanks, Zach. | checked with the AWS team over the weekend and they’re in discussions with Virginia and several other 
states about how they can help. One AWS product | is of interest to several states, Amazon Connect, 


Also, | wanted to let you know what we've been following up extensively with Ohio, both at the state level and with 
several county governments. We’ve got several things potentially in the works. For example, we have an executive now 
serving on the state Vaccine Project Logistics Committee, we will likely be providing employee volunteers to some 
events in Columbus, and we may be offering some of our facility parking lots for clinics in Lucas County. We’ve made 
contact throughout the state and there will likely be some other collaborations soon. 


Please keep forwarding us things — we’re happy to help anywhere and anyhow. 


From: "Butterworth, Zach Z. EOP/WHO" <O who.eop.gov> 
Date: Friday, February 19, 2021 at 6:08 PM 


To: <}© amnazon.com>, "Wakana, Benjamin L. EOP/WHO" 
TEE w10.20p.gov> 


Ce: "Slavitt, Andrew M. EOP/WHO" <Q who.eop.gov> 
Subject: [EXTERNAL] Following Up 


NOONAN EINEM EODO USOT EDONE EDEN DOLE OE SSO EO NON ISLOLENIEOE ELON CENEINE NESE ISESE HIS ENISECEDIDISEPLSNIOE ISIE EDSOEEOIDEETEISAD NISSEN ISOODERSSEENEDEORI OAL DUD DINE IEEE TSISEEEORIOPEEIONOLEUEDOEN DIN EESEPESESEU CISC TDSSNUISEOTNESLOEEEISPOUSODEEEDSIETEIDOOCOO ISIE RISE ENISOE ESIC TIEN CENDINTCIEBEROISODEHIBCENISCENIINNC ESS 


"CAUTION: This email originated from eral of the organization. Do not click links or open attachments 
junless you can slid the: sender and BONY el content is safe. 


Srrvocansorcnnwnennesinde 


prrernannanennannenranenng : 


= - | spoke with Andy today and we wanted to flag the article below. The last paragraph mentions 
Virginia’s success in getting providers to release doses by having a public portal that shows who has the vials 
and the percent administered. If you all are working with states, this may be a worthwhile area for effort. 
Many thanks, Zach 


>>htips /Avww. nytimes com/ 202 1/02/ Siis/coronavirus-vaccines. himl?referringSource=articieShare<< 
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Sent: 3/2/2021 9:42:52 AM 
To: (EE @ amazon.com] 
Subject: Books Vaccine Misinformation Policy_020821 


Attachments: Books Vaccine Misinformation Policy_020821.docx 


Ok, a quick update. 


1/ We will not be doing a manual intervention today. The team/PR feels very strongly that it is too visible, and will 
further compound the Harry/Sally narrative (which is getting the Fox News treatment today apparently), and won’t fix 
the problem long-term problem because of customer behavior associations. If we completely remove customer behavior 
associations it will break the search. 


2/ I’ve asked the team to widen the search light flag for COVID-19 CDC website re-direct so that it comes to the top of 
the page on more search keys. They can hopefully implement that today and you should be able to share a screen shot. 


3/ ae tag teaming some reactive messaging for your re policy, response, etc. It won’t be 
satisfactory. The WH will probably ask why we don’t tag the content like FB/Twitter do if we aren’t taking it down. That 
is an option being explored but that we don’t want to disclose to avoid boxing in. 


The attached is the still in flux doc to review with on March 19. BMeave very direct guidance to the teams to be 
boring and not do anything that is visible and will draw more attention. 
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Sent: 3/2/2021 11:38:14 AM 

To: NE © 2200.01); AAS amazon.com}; ._—<— 7 
HEB @ amazon.com) 

Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 

Flag: Follow up 


Thanks this is helpful. 1’ll suggest that [J use the below in his call, unless there are any objections. 


From: © amazon.com> 

Sent: Tuesday, March 2, 2021 1:54 PM 

To: © amazon.com>; iE © amazon.com>; 
HS @ amazon.com> 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 
Thanks i, adding from CRM and i 


For Q1- this is not something we’ve had come up in the past and is taking the guidelines out of context. The line cited is 
referring to misleading metadata, typos, image quality issues, etc., not the actual truthfulness of the theories described 
within the text of a book. With that in mind, a possible response would be: 

° No, the line you’re referring to is addressing publishing errors like typos, formatting issues, image quality etc. 
You can review examples of examples of content that's typically disappointing to customers in the Guide to Kindie 

* Our guidelines address content that is illegal or infringing, generates a poor customer experience, or that we 
otherwise prohibit, such as pornography. Our guidelines do not specifically address content about vaccines. 


For Q2- again this is not something we’ve commented on before, and | think we would avoid making a commitment on 
this now, as we are still debating possibly doing so in the future. | recommend a response along the lines of: 


° We believe that retailers are different than social media communities which means we review the content we 
make available, where we make it available in our store, and how we address content that customers find disappointing. 
e As a retailer, we provide our customers with access to a variety of viewpoints, including books that some 


customers may find objectionable. All booksellers make decisions about what selection they choose to offer and we do 
not take selection decisions lightly. 


From: fumes © ammazon.com> 
Sent: Tuesday, March 2, 2021 10:20 AM 


To: iE © 2 220n.com> 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 
Thanks 
Could we work up reactive FAQs to these questions for Jj call? 


1, Doesn’t this line in your policy include the spread of misleading information about vaccination: “We do not 
allow descriptive content meant to mislead customers” 


2. Why don’t you tag books that are not scientifically sound the way FB/twitter tags content. 
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Let me know if it’s easiest to talk through these. (And piease do add back anyone from the wider group who would need 
to participate in the discussion.) 


NAZON.COM>> 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 


From: 
Sent: Tuesday, March 2, 2021 8:47 AM 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 
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Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 


From 


Sent: Tuesday, March 02, 2021 6:38 AM 


Naggar, David 


; Naggar, 


ee > on 


Subject: RE: [Privileged and confidential] - Vaccine misinformation in bookstore 


Sent: Tuesday, March 2, 2021 9:25 AM 


AMZN_HJC_0006228 


Subject: ieaiieesa and confidential] - Vaccine misinformation in bookstore 
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Sent: 3/3/2021 3:51:14 PM 
To: @amazon.com] 


Subject: Re: Vaccination education and Amazon Gateway 


From: 


Thank youll for the continued support of the AdCouncil vaccination education efforts! | really appreciate the 
advocacy. Please let me know if | can be any help in helping getting placements on our site. 


From: ST © 2mazon.com> 


Date: Wednesday, March 3, 2021 at 2:58PM 

To: < amazon.com> 

EEE 2 2m220n.com>, TE EEO 2:n220n.<on> 
amazon.com> 

Subject: Re: Vaccination education and Amazon Gateway 


Thank you so much, all. 


a can send you the specific background on the campaign for visibility. 


oil ll grab time to connect. 


Thanks again!! 


On Mar 3, 2021, at 5:52 PM, i 2 amazon.com> wrote: 


Great, thanks A think you can work witHiiifon the details of the best way to do this. 


From: amazon.com> 
Date: Wednesday, March 3, 2021 at 2:51PM 
amazon.com> 


amazon.com>, [il < [IO amazon.com> 
amazon.com> 


Subject: Re: Vaccination education and Amazon Gateway 


As context {J we funded, together with a lot of other brands, mass advertising education re: vaccination. 
| agree re: taking people off site being a concern, but also agree that we should find a way to support the request of an 
onsite message in some way. 


On Mar 3, 2021, at 1:49 PM, iS © amazon.com> wrote: 
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This first sentence makes me think | might have missed something earlier on this — as this is the first time I’m hearing 
about this? \'m assuming you have more context on this. 


|'m a little concerned whenever we are proposing things that link off Amazon, as it takes customers out of their 
shopping context. If we are talking about doing it in the mobile app at all, I'd be more ok with it provided it links to an 
embedded “overlay” browser, as that doesn’t take you out of the shopping app (closing it takes you back to the app). On 
mobile, | would not be ok with this taking customers out of the app by directing them to the native browser app. 


HERE (Homepage 
From: i © 2mazon.com> 


Date: Wednesday, March 3, 2021 at 1:33 PM 


To: i GE 2 1220n.com>, i © amazon.com> 
Cc: i © amazon.com> 


Subject: Vaccination education and Amazon Gateway 


Thank you again for your support to sponsor the Ad Council’s vaccination education campaign. This has been a key 
component in our campaign to earn policymaker trust and help support vaccination distribution and awareness. We are 
continuing to leverage this campaign in outreach to state, local, and federal stakeholders as well as the White House. 


We'd like to ask your consideration to display one of the Ad Council's campaign assets on the gateway. We believe 
providing this content would go along way in contributing to the campaign, as well as earning Us goodwill at the White 
House. 


More urgently, as part of our ongoing conversations with the White House COVID task force, staff alerted us to their 
serious concerns with the misinformation or anti-vaccination books sold in the store. We will continue to sell these 
books, though we have taken steps to increase the COVID searchlight as well as other DNP measures for the anti- 
vaccination books. 


It is our recommendation that customer education on the front page, would provide better education cover than just 
the searchlight feature, and also help mitigate some of the misinformation concerns we are confronting. | will note a 
similar placement was very effective at the start of the pandemic when we featured the Ad Council’s social distancing 
campaign on the gateway. 


Thank you for considering, and please advise if you are supportive. If so, | am happy to work with your designee to 
access the ad councils assets. 


An example is below: 


<image001.jpg> 
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Sent: 3/3/2021 7:02:43 PM 
To: (G2 amazon.com) EE 6 amazon.com] 
Subject: Misinformation update 


Quick update. 


GE wants to alert (before actioning do not promote, but agrees we should go forward. 


Team is expanding search light keywords. However they are not sure if they can get the content itself 
adjusted but are looking into it. 


GMB and GMsigned off on the gateway but it’s likely a display ad frame on the gateway (which we 
knew). That’s going to take a couple days and may not be up by Friday. 


BM ha: agreed to join us when we meet with them. 
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3/9/2021 11:34:55 AM 


To: @amazon.com) Ee © amazon.com) a’ 
@amazon.cor) 

cc: amazon, 0m) is 2220n.con) iE © amazon.com] 

Subject: RE: New CPP rule for Anti-vax books 

Flag: Follow up 


Thanks So ead 


We will update the SOP accordingly . 


From: ae 


Sent: Tuesday, March 9, 2021 1:01 PM 


To: amazon.com>; amazon.com>; ae 


@amazon.com>; 


amazon.com>, 
amazon.com> 


@amazon.com> iE ©2mazon.com> iii 
@amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


Hi al! i and | created the Anti-vax DNP Shell class and added the 43 ASINs below. NSOC team can now add ASINs to 
/SC/KindleCRM/Shell_ AntiVax_DNP using the 


Regards, 


From: 
Sent: Monday, March 8, 2021 2:38 PM 


To: amazon.com>; amazon.com>; 
amazon.com> amazon.com > 


amazon.com> 
amazon.com>; iii EE © amazon.com>; ig 
amazon.com> 
Subject: RE: New CPP rule for Anti-vax books 


Great, thanks, A That SIM is sufficient. Shell DNP classes are easy to set up, so HB and | will work on this request 
tomorrow and have it up and running by the end of the day. The only remaining action item will be for NSOC to update 
their SOP to call out the new class once we have it created. 


Regards, 
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From: 2 25 2201.com> 


Sent: Monday, March 8, 2021 2:05 PM 


amazon.com>,; amazon.com>; 
amazon.com>; amazon.com> 


amazon.com> 
4 amazon.com>; amazon.com>; I 
B® amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


Is the expectation the same for anti-vax content, or is the request here to develop a keyword-based approach to 
proactively classify new ASINs? 

- Same expectation. Plan is for NSOC to identify and flag books as violating this policy, and add them to the DNP 
class. 


GE is the team able to use this SIM to kick off the effort of building a new anti-vax class? 
https://issues.amazon.com/issues/CRMAUTO-638. | think we’ll want a specific anti-vax class, as it’s not yet clear what 
actions we'll take as part of a potential misinfo policy. 


Thanks, 


Fro © 2r220n.com> 


Sent: Monday, March 8, 2021 1:59 PM 
To: amazon.com>; amazon.com>; 
amazon.com>; amazon.com> 


amazon.com> 
amazon.comp; amazon.com i 
amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


Hi all, apologies for the delay in response here while | was out. 


Shell_ Extremist_DNP is intended only for ASINs identified by NSOC to contain extremist content, and/or for ASINs from 

extremist publishers. Given the urgency of this request, I’m ok with using this class for this purpose once, but long term 

it would be better to create a new class specifically for anti-vax (or misinformation/harmful medical advice/however we 
want to classify this). 


Currently, all of our DNP classes (Extremist, Racially Sensitive, and Transgender Youth) are ad hoc and ASIN-based. Once 
NSOC identifies an ASIN, it’s added to the shell class. Is the expectation the same for anti-vax content, or is the request 


here to develop a keyword-based approach to proactively classify new ASINs? 


Regards, 


From fi © 27 220n.com> 


Sent: Monday, March 8, 2021 10:52 AM 


amazon.com> amazon.com>; =, 


amazon.com> .com> 


amazon.com>) noo _izZz”! 


amazon.com> amazon.com> 
Subject: RE: New CPP rule for Anti-vax books 
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Ok, we have signoff to proceed with this. Let’s go ahead and add the books below to our DNP class. 


ze others in automations: Given the rule we'll be adding to is an ad hoc class, do you have recommendations for 
how we’d handle a new, broad DNP policy for anti-vax content? 


Thanks, 


From: 


Sent: Thursday, March 4, 2021 1:49 PM 


R A a amazon.com>; iii 
A amazon.com> 
@amazon.com>; a amazon.com> iii 
{@ amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


Sorry, | was only hoping to get the class set up. Let’s hold on actually pushing anything to prod until we get the go ahead 
from leadership. I'll check in here when we’re ready to go. 


Sent: Thursday, March 4, 2021 1:41 PM 


To: amazon.com>; amazon.com >; =a 


GO amazon.com>; amazon.com> 
Ce: schibeuaaines omavon.con> 
BE 2 amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


Thanks 


Working on it. 


From: 
Sent: Thursday, March 4, 2021 3:32 PM 


To: amazon.com> amazon.com>; is 


amazon.com>; amazon.com> 


: amazon.com> amazon.com>; i! 
MH © amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


eI 
id 


We already have a CPP class to handle ad-hoc requests to block promotion: Shell_extremist_DNP. This is handled by 
NSOC, | have addedlfto the thread. 


MM can you please 
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We'll keep the SIM open to create a new DNP policy and class for anti-vax, please keep us updated when the policy is 
fleshed out, 


From ED @ amezon.com> 


Sent: Thursday, March 4, 2021 2:18 PM 


To: amazon.com>; amazon.com> 
Ce: amazon.com>; amazon.com> 
HE @ amazon.com> 


Subject: RE: New CPP rule for Anti-vax books 


re and Automations 


Hi team, | submitted SIM https://issues.amazon.com/issues/CRMAUTO-638 to create a mew DNP class for anti-vax 
books. The impetus for this request is criticism from the Biden administration about sensitive books we’re giving 
prominent placement to, and should be handled urgently. 


Thanks, 


From as 


Sent: Thursday, March 4, 2021 11:48 AM 


To: amazon.com> 


Cc: @amazon.com>; @amazon.com> 


Subject: New CPP rule for Anti-vax books 


Hi ziven Sa is out of the office, I’m hoping you can help me set up a new DNP class in CPP. 


What process do we need to follow? This is a high priority intended to address negative feedback we're getting from the 
Whitehouse’s Coronavirus Taskforce. 


Thanks 


--| Books 
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From: 


Sent: aaa 8:28:09 AM 
To: amazon.com]; © amazon.com] 


Subject: RE: Vaccine Misinfo Books Policy 


Flag: Follow up 


Did | miss it, or did we remove DNP as an option or part of an option (maybe subsumed by Deny Term List)? 

We’re considering DNP as complete, and moved the description to FAQ #2. Due to criticism from the Biden 
people, PP asked us to pursue ‘low hanging fruit options’ prior to our Russ review, and this was one of them. There's a 
separate thread out tof sking for his permission to implement prior to our 3/19 meeting. 


What if we’re not willing to wait for the Alerts Messaging widget? What would we do in the meantime? The next 4 
months of the vaccine response/adoption are going to be critical. 

Search is looking for ways to shorten the lead time on this, but agree 18 weeks is too long. 

| think the next best option is to remove from sale. 
- BB still likes the idea of labeling on its own, but | feel like that’s a half measure that doesn’t tangibly address 
the risk. (Search data shows customers who buy this content are looking for specific books and using high intent queries, 
which means customers will likely continue to consume this content in spite of our warnings, perpetuating the current 
CX — but with more labels.) 

A third option is to build a labeling CX in parallel with the alerts widget, and implement in a phased way if we 
can’t speed up the 12-18 weeks estimate. I’m working with search to understand if this can even be done. 

I'll add all of this to the doc 


From amazon.com> 
Sent: Monday, March 8, 2021 6:12 AM 


10 EE 6 20)2200.com> EE © amazon.com> 


Subject: RE: Vaccine Misinfo Books Policy 


Sorry | missed this one! Cool to see where this is headed and | like the chart in the FAQ about how this would apply to 
other misinformation. Couple of questions: 

sf Did | miss it, or did we remove DNP as an option or part of an option (maybe subsumed by Deny Term List)? 

2s What if we’re not willing to wait for the Alerts Messaging widget? What would we do in the meantime? The next 
4 months of the vaccine response/adoption are going to be critical. 


== Original Appointment 


From: © amazon.com> 


Sent: Friday, March 5, 2021 10:56 AM 


chime.aws; chime.aws 


Subject: Vaccine Misinfo Books Policy 
When: Friday, March 5, 2021 8:00 AM-8:50 AM (UTC-08:00) Pacific Time (US & Canada). 


Where: Meeting ID: Piiiie<7| 


Critical Attendees 


Additional Attendees: 


Context of Meeting (decision-based, Get input on anti-vax proposal doc 
inform, get input): 


864 


AMZN_HJC_0007390 


If decision-based, 1) what is the decision? 
2) who needs to make decision? 3) is it a 
one-way door decision? If yes, why? 


You have been invited to an online meeting, powered by Amazon Chime. 

Click to join the meeting: 

Meeting ID: 

A headset is recommended or you may use your computer’s microphone and speakers. 


Call in using your phone: 


United States Toll-Free: 
Meeting ID: 


One-click Mobile Dial-in (United States Toll-Free): $= asl 


United States (1): 
International: 


Dial-in attendees must enter *7 to mute or unmute themselves 


To connect from an in-room video system, use one of the following Amazon Chime bridges: 


SIP video system: lor meet.chime.in 


H,323 system. 


if prompted enter the Meeting PIN: 
Download Amazon Chime at https://aws.amazon.com/chime/download 


For information about creating an Amazon Chime account, see https://aws.amazon.com/chime/getting-started 
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Sent: 3/8/2021 6:12:20 AM 

To: @amazon.com] ES amazon.com] 
Subject: RE; Vaccine Misinfo Books Policy 

Flag: Follow up 


Sorry | missed this one! Cool to see where this is headed and | like the chart in the FAQ about how this would apply to 


ather misinformation. Couple of questions: 


1. Did | miss it, or did we remove DNP as an option or part of an option (maybe subsumed by Deny Term List)? 
2. What if we’re not willing to wait for the Alerts Messaging widget? What would we do in the meantime? The next 


4 months of the vaccine response/adoption are going to be critical. 


From: @amazon.com> 
Sent: Friday, March 5, 2021 10:56 AM 
To 


Cc: meet@chime.aws; [© chime.aws 


Subject: Vaccine Misinfo Books Policy 
When: Friday, March 5, 2021 8:00 AM-8:50 AM (UTC-08:00) Pacific Time (US & Canada). 
Where: Meeting ID: 


Meeting Subject / Agenda: Review policy proposal to handle anti-vax content in Books 


Critical Attendees: 
Additional Attendees: 


You have been invited to an online meeting, powered by Amazon Chime. 


Click to join the meeting: 
Meeting ID: 


A headset is recommended or you may use your computer’s microphone and speakers, 


Call in using your phone: 
United States Toll-Free: 
Meeting ID: 
One-click Mobile Dial-in (United States Toll-Free): =e 
United States (1): 
International: 
Dial-in attendees must enter *7 to mute or unmute themselves. 


To connect from an in-room video system, use one of the following Amazon Chime bridges: 
SIP video system: @ meet.chime.in or meet.chime.in 

H.323 system: 
lf prompted enter the Meeting PIN: 
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Download Amazon Chime at https://aws.amazon.com/chime/download 


For information about creating an Amazon Chime account, see https://aws.amazon.com/chime/getting-started 
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From: ME 0 AMAZ0N/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN= 
Sent: 3/9/2021 10:05:54 AM 
To: amazon.com]; ii? amazon.com); iy 
@amazon.com] 
cc: amazon.com] 
Subject: RE: Pre-Brief for Meeting w/ the White House 


fase ~ here is the condensed script for 1:30 


GE intro: 


. Thank you again for reaching out and flagging your concerns. 


. We are all in this together, and Amazon is working hard, and fast, to be a productive contributor in 
vaccine rollout and education. 


. Across Amazon we have a number of teams and machine learning systems looking at the products in 
our store and enforcing our policies. 


. With respect to our Bookstore. We have content guidelines and we have a large team dedicated to the 
incredible challenge of both creating and enforcing our policies and curating the bookstore. 


+ Books are simply different than any other product we sell, or content we distribute. Bookstores are 
home to written speech. Amazon does not endorse the content of any book or video it offers, but we strive to 
offer the widest possible selection of speech to our customers. [If rebutted with “anything goes at Amazon” 
line - pivot to | 


* We recognize that COVID vaccination is a wholly new matter, and so we have a team of experts here to 
walk through the steps we have taken. 


* IF PRESSED IN CONVERSATION: these are incredibly challenging issues, particularly as the team looks at 
ongoing data and feedback from global health authorities. If you see something specific related to COVID, we 
welcome your feedback so that we can continue to review and learn. 


Misinformation Ii: 


e We see misinformation, and misinformation around COVID, as a serious issue, and so across Amazon 
we have taken steps to fight the spread of harmful misinformation. 


° Amazon’s marketplace requires that sellers provide accurate information on product detail 
pages and put processes in place to proactively block inaccurate claims about COVID-19 before they are 
published to our store. We’ve also developed specific tools for COVID-19 that run 24/7 to scan the hundreds 
of millions of product detail pages for any inaccurate claims that our initial filters may have missed. 
Collectively, our efforts have blocked more than 6.5 million products. 


° Alexa Skills implemented a mandatory review process, erring on the side of only allowing skills 
submitting by official government or accredited news sources. 


° In 2020, Appstore made the policy decision only to allow COVID-related content in apps 
submitted by official government entities or news organizations, in order to reduce potential for false or 
misleading medical information. In 2020, we rejected more than 90 Fire TV apps for including COVID-related 
content. 


° Our store quickly implemented reviews of COVID-related products and our advertising systems 
blocked advertising against key COVID related terms/products. 
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+ We are a sponsor of the Ad Council’s recently launched vaccination education campaign - one of the 
largest public education campaigns in history - and we are currently in the process building out a display space 
on Amazon’s Homepage for the AD Council’s campaign content. Our homepage is our first, and best, line of 
communication with customers and will serve as the most important line of defense for educating Amazon 
customers about vaccination. 


Other steps we have taken for books IE 


e For books, we have COVID-specific policies that have prevented the sale of over [20k (could reduce to 
10k, but checking number)] books. This includes books that were advocating “cures” of COVID and the like. [IF 
PRESSED—try to avoid specifics about vaccine in general, but could if pressed could say that books with a 
primary theme that the coronavirus vaccine is unsafe or unnecessary.] 


° High-risk anti-vax books: We have taken steps to ensure the highest-risk titles are excluded from being 
picked up by our automated merchandising discovery tools. Examples of these tools are Amazon’s Choice and 
Amazon Deals. Specifically, these tools are all part of automated systems that identify highly-rated, well-priced 
products that are available to ship immediately. {those well-known, routinely populated, titles: High risk 
content has the primary purpose of persuading the reader that, against direction from authoritative public 
health sources, one or all vaccines should be avoided because they are unsafe or ineffective.) 


° We’ve added links to authoritative sites (ex. the Centers for Disease Control and Prevention and the 
World Health Organization) at the top of the search result pages if a customer searches for books related to 
vaccines or the coronavirus. 


° Our COVID signpost surfaces links to authoritative health organizations when customer input vaccine- 
related search queries. Upon further inspection following your last conversation with a. we have widened 
the number of key terms that will populate this signpost. 


° Our COVID detail page messaging surfaces links to authoritative health organizations on covid-related 
books. 
° Books are unique, and an important part of Amazon’s DNA. We are going to sell controversial books, as 


all libraries and other bookstores do. We have a high bar for removing book selection at Amazon and we do 
not take these decisions lightly. 


Content Guidelines: 


$ [if pressed—reactive] The Content Guidelines for Books are intentionally broad. In any content 
moderation system there is a push/pull between broad enough to provide discretion in decision making and 
specific enough to provide guidance on what is allowed. Being too specific results in the need to make more 
public changes and can allow authors to game the system. Being too broad risks being accused of lack of any 
decision making framework. We review both our Guidelines and our approach to curating Amazon’s bookstore 
regularly. 


e We design our policies so that decisions can be made as consistent as possible and based on objective 
criteria that is applied to the facts and content. We value having a wide variety of content that includes 
disparate opinions and content that contributes to the information and debate in an open and free society. To 
do this, we focus on creating policies that are narrowly-tailored to the risks we’re solving for and 
implementing procedures that ensure we’re making fact-based and consistent decisions. 


From: 


Sent: Tuesday, March 9, 2021 11:59 AM 
10: © amazon.com>; ii © 2mazon.com>; 
{© amazon.com> 
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Cc: EI amazon.com> 


Subject: Pre-Brief for Meeting w/ the White House 
Hi all — here are the notes for our Pre-brief discussion with the White House today. 


Thank you. 


I. Books Curation and Guidelines 101 ——aee 


° Top Talking Points (to be made affirmatively) [Is the Admin asking us to remove books, or are 
they more concerned about search results/order (or both)?] 


° Books are unique, and an important part of Amazon’s DNA - TBC - Books are not UGC/Social 
media. We have a high bar for removing book selection at Amazon and we do not take these decisions lightly. 
“Books cannot be compared to social media and communications content. We are mindful of a global history 
rife with book censorship, and we do not take this lightly.” 


° “As a bookseller, Amazon strongly believes that providing open access to written speech, 
including a variety of viewpoints, is one of the most important things we do. We also make available to readers 
the ability to make their own voices heard and express their views about this and all our titles in reviews and 
ratings.” 


° “Amazon does not endorse the content of any book or video it offers, but we strive to offer the 
widest possible selection of content to our customers and we offer a variety of ways to engage with that content: 
customers who wish to express their views on any title may do so in reviews, as many do, on its product page in 
our store.” 


° Top Talking Points on Content Guidelines 


° Unlike many of our bookseller peers, we do provide public facing Content Guidelines for Books 
(Wal-Mart and Barnes and Noble do not). - Note: the first returned results on Wal-Mart is a Dr. Sears book (not 
anti-vax, but not pro-vax either); and on BN, it is a mixed bag of page one returns. (BN goes even further in its 
policies to say its search algorithm cannot be manually manipulated). 


° We know that we will sell content that some customers may find objectionable. 


° The Content Guidelines for Books are intentionally broad. In any content moderation system 
there is a push/pull between broad enough to provide discretion in decision making and specific enough to 
provide guidance on what is allowed. Being too specific results in the need to make more public changes and 
can allow authors to game the system. Being too broad risks being accused of lack of any decision making 
framework. We review both our Guidelines and our approach to curating Amazon’s bookstore regularly. 


fo) “We design our policies so that decisions can be made as consistent as possible and based on 
objective criteria that is applied to the facts and content. We value having a wide variety of content that includes 
disparate opinions and content that contributes to the information and debate in an open and free society. To do 
this, we focus on creating policies that are narrowly-tailored to the risks we’re solving for and implementing 
procedures that ensure we’re making fact-based and consistent decisions.“ 

° “We have dedicated teams of trained professionals that specialize in case-by-case analysis of 
controversial content, and these decisions go through rigorous analysis by multiple teams at Amazon.” 


° Top Talking Points on Search 


° We consider many factors when choosing the shopping results to feature for customers including 
customer actions (such as purchase frequency), item information (title, price, and description), and availability. 
Further, the browse node a customer selects will affect the returned results; e.g.; searching within the full store 
v. the books store. 
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) Bestseller lists are not curated—they are measured by book sales and simply reflect the books 
customers are purchasing. 


° Our shopping and discovery tools are not designed to generate results oriented to a specific point 
of view and we are always listening to customer feedback. 


° Shopping and discovery tools are algorithmic and dynamic. Algorithms can create results that 
may not appear to make sense, and we look at why results are being presented and seek to improve. However, 
changes are complicated to make as you may change the weight or input of a value and that change can have 
unintended consequences elsewhere. Therefore changes in this area can often taken time and require a lot of 
testing. [Even manual intervention cannot fully prevent customer behavior from driving engagement on a given 
product. ] 


. All that said, we are committed to providing a positive customer experience and encourage customers to 
refer to government sources for frequently updated, authoritative guidance. 


Il. Specific Books Steps Taken [RT 


° High-risk anti-vax books: We have taken steps to ensure the highest-risk titles (those well-known, 
routinely populated, titles: High risk content has the primary purpose of persuading the reader that, against 
direction from authoritative public health sources, one or all vaccines should be avoided because they are unsafe 
or ineffective.) are excluded from being picked up by our automated merchandising discovery tools. Examples 
of these tools are Amazon’s Choice and Amazon Deals. Specifically, these tools are all part of automated 
systems that identify highly-rated, well-priced products that are available to ship immediately. [This measure 
exclude these titles from ‘Amazon Choice’ program, ‘Prime Exclusive’ pricing, Alexa Shopping Notifications, 
detail page Similarities widgets, GOK, Amazon Deals, Amazon Rewards, Books marketing programs, and 
outbound promotions/recommendations. } 


° We’ve added links to authoritative sites (ex. the Centers for Disease Control and Prevention and the 
World Health Organization) at the top of the search result pages if a customer searches for books related to 
vaccines or the coronavirus. 


° Our COVID signpost surfaces links to authoritative health organizations when customer input vaccine- 
related search queries. Upon further inspection following your last conversation with a. we have widened 
the number of key terms that will populate this signpost. 


° Our COVID detail page messaging surfaces links to authoritative health organizations on covid-related 
books. 
° We are a sponsor of the Ad Council’s recently launched vaccination education campaign - one of the 


largest public education campaigns in history - and we are currently in the process building out a display space 
on Amazon’s Homepage for the AD Council’s campaign content. Our homepage is our first, and best, line of 
communication with customers and will serve as the most important line of defense for educating Amazon 
customers about vaccination. 


III. Steps we have taken across Amazon re vaccination iW 


° We are also educating our workers about the importance of vaccinations and encourage all of them to 
get vaccinated as soon as they are eligible, to protect themselves, their families and their communities. 


° Our COVID19 Chief Medical Officer, Vin Gupta, recently held a virtual Q&A session, where he 
answered more than 200 questions from employees. 


° We have also developed communications tailored to our diverse workforce, with particular attention 
paid to communities who are skeptical about vaccinations. 

° And we are offering up to $80 to workers who become eligible and get vaccinated in the community. 
° Based on our experience offering on-site testing at 700+ worksites around the country, We think that 


bringing vaccination clinics on site is what will really help drive vaccine adoption. To that end, we are building 
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Exhibit 135 


Internal Amazon email correspondence 
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From: | /O=AMAZON/OU=EXCHANGE ADMINISTRATIVE GROUP 
(FYDIBOHF23SPDLT)/CN=RECIPIENTS/CN- iii | 

Sent: 3/16/2021 2:21:49 PM 

To: Rogers, Ty (© amazon.com); EEE @ arn.azon.com) 

cc: ES @ 2.22000) © amazon.com); 

HE amazon.com); i amazon.com] 

Subject: Privileged and Confidential- upcoming negating Buzzfeed story on Covid 19 book 

Attachments: Books Vaccine Misinformation Policy_031621.docx 


BMB- seeking legal advice. 
Hi Ty, 


Wanted to follow up with two related points regarding books sold on Amazon that contain vaccine misinformation: 

° As | mentioned below, there’s a S-team meeting with it GMM and David Z and the Books/ Search teams to 
discuss a proposal for how Amazon should address the shopping experience for vaccine misinformation books. While the 
doc is still being finalized, I’ve attached a draft to this note. The Books team is planning to share a draft with 4 VPs vial 
email tomorrow (across Books and Search). Would you like to be included in that email? Would you like me to have 
Mfinciuded on that email? I’m also happy to flag separately toi that would be helpful. Again, I’m trying to 
avoid folks being surprised on this as actions the Books/ Search teams take would likely be highly visible and scrutinized 
externally. 

fe) EE 210 HE anyone on the PP side | should make sure is in the loop on this as well? 

e Separately, the Suzzfeed article on this topic posted yesterday and as we anticipated, it is negative. It rehashes 
many of the concerns we’ve seen raised in past stories regarding how these titles are surfaced to customers. Researches 
quoted throughout the story also suggest Amazon is doing the least to stop the proliferation of misinformation (when 
compared to FB, Twitter, YouTube, etc.). The article also leans into concerns that Amazon is rarely transparent about 
when/ why it removes a title. For now, the article seems fairly contained and we have not seen many additional reposts. 


Thanks, 


Amazon Is Pushing Readers Down A "Rabbit Hole" Of Conspiracy Theories About The Coronavirus 
Buzzfeed News 
Craig Silverman and Jane Lytvynenko 


nhackansnronnennnnnenntnnntiennsnnsanninnantanntanninennnneranmnenintatarannannsnnetniorsnnnnnnnncannnedennnncannrenchntrennmarnnncannntcennnnennnlatarataranntorensinntanennennncnnnnnnennnnoanninrannennentinrbinmonanmnnnnanhcnanninnncnnnenh 


From: Rogers, Ty <@ amazon.com> 


Sent: Friday, March 12, 2021 3:11 PM 
To: @amazon.com> 


@amazon.com>; iE © amazon.com>; 
@amazon. com> I amazon.com 


Subject: Re: Heads up- upcoming negating Buzzfeed story on Covid 19 book 


Sounds good, thanks. 


On Mar 12, 2021, at 3:10 PM, @amezon.com> wrote: 


Nothing really new, just a rehashing of the same complaints and study we've seen brought up a few times. I know 
Buzzfeed can sometimes inspire others to write though, so wanted to make sure you were aware, 
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From: Rogers, Ty <@e 


Sent: Friday, March 12, 2021 3:06 PM 


PAT} me an IA" f . 
BA cst 4 eerie, 
, Pie oT ee 


Subject: Re: Heads up- upcoming negating Buzzfeed story on Covid 19 book 


a? 


Thanks for the heads up. Do you think there will be anything substantively new in their story? If it’s just a rehash of 
what’s out there, | don’t think it needs a broader heads up. But if it’s new/big/nasty in some way, a heads up never 


hurts. 


From: i © 2:1220n.com> 


®amazon.com>, iii 
M@Mamazon.com> 


Subject: Heads up- upcoming negating Buzzfeed story on Covid 19 book 


Ty- heads up that we anticipate Buzzfeed will run a negative story looking at Covid-19 related books for sale on Amazon. 
The story touches on many of the points we've seen raised over the last year and i worked closely with CC’s team for the 


points related to Search, Reviews, and Personalization. 


Related to this topic, the Books team has a meeting on 3/19 with BBB and David Z to take a closer look at books 


related to vaccine misinformation and debating additional steps Amazon might want to take to reduce the visibility of 
these titles. The Books Content Risk Management team is still working on their doc for the 3/19 meeting, but | would be 


happy to share non-final draft if you’re interested. 


Ee ave been our close counterparts on this one, as PP is feeling pressure from the White House 


Taskforce on this issue as well, 


Let me know if you have any questions or if this needs to go further up the flagpole. 


Thanks, 


From: Bamazon.com> 


Sent: Friday, March 12, 2021 2:36 PM 


——————E—=——= 


Zon. com> 


Subject: Re: Media Inquiry: Buzzfeed story on Covid 19 books- 5pm Deadline 


I’m ok with our response 


Fron: i © 2:220n.com> 


Date: Friday, March 12, 2021 at 1:02 PM 


@amazon.com> 
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ME 2 202200.com>, EE © 2.12200.com>, BB 2 220n.com>, 


Subject: Media Inquiry: Buzzfeed story on Covid 19 books- 5pm Deadline 


ae 
jeEt several 


universities are participating in that examines how and why conspiracy narratives circulate in different platforms and 
online spaces during a crisis. We first saw this research project covered by Politico back in December when Amazon was 
criticized for selling Coronavirus and QAnon conspiracy theory books. 


\’ve pasted the reporter’s email below, but his primary concerns/ questions focus on: 


@ How these titles are surfaced and promoted to customers 

e The specific content of the books spreading misinformation 

e Amazon profiting from the sale of this concerning content 

® A belief that Amazon is doing the least to address these concerns (when compared to FB, Twitter, Google, etc.) 
e Why Amazon decided to remove QAnon books 

° What our policy is regard conspiracy & Covid books 


We’ve had CRM review all titles mentioned and have worked with the teams who specialize on Search, Reviews, and 
Personalization tools. One book (out of 9) was found to violate our COVID policy and was removed. As a reminder, we 
did enable Do Not Promote for anti-vax books whose primary purpose is to persuade readers vaccines are unsafe or 
ineffective on 3/9, and will review additional handling options for these books with you, fj and [fon 3/19. 
However, many of the books highlighted by Buzzfeed are about COVID conspiracies not vaccination, and are therefore 
out of scope for this policy effort. CRM plans to resume work on a broad misinformation policy again once we align on 
an approach for anti-vax books. 


In light of this we recommend sharing the below statement and background points (similar to our past responses on 
these concerns). The background points we include below were also approved by the Personalization, Search, and 
Reviews teams. 


The reporter's deadline is 5pm PT today. Please take a moment to review our proposed response and share any 
feedback. 


We anticipate this will be a very negative story and have also alerted PP. 


Recommended Response for Review 
On the Record: “We’re committed to providing a positive customer experience and encourage customers to refer to 


government sources for frequently updated, authoritative guidance. We’ve added links to these sites (ex. the Centers for 
Disease Control and Prevention and the World Health Organization) at the top of the search result pages if a customer 
searches for books related to vaccines or the coronavirus. Additionally, our store maintains content guidelines and 
removes products that do not adhere to these policies-- which can be found here for books. We invest significant time 
and resources to enforce these guidelines, using a combination of machine learning, automation, and dedicated teams 
of human reviewers.” 


On Background: 
° Our shopping and discovery tools are not designed to generate results oriented to a specific point of view and 
we are always listening to customer feedback. 
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